|
Asyncio + Rasterio for slow network requests?
Hey Sean, Sorry, I should have been clearer. As it stands, my statement is false: GDAL is of course designed to be thread-safe, so doing concurrent reads in different threads *should* work. But in our
Hey Sean, Sorry, I should have been clearer. As it stands, my statement is false: GDAL is of course designed to be thread-safe, so doing concurrent reads in different threads *should* work. But in our
|
By
...
· #483
·
|
|
Asyncio + Rasterio for slow network requests?
Hey Kyle, maybe I can help out here. - asyncio's run_in_executor does the exact same thing as using a thread pool, it's just a different API. Until both GDAL and rasterio explicitly support this, you
Hey Kyle, maybe I can help out here. - asyncio's run_in_executor does the exact same thing as using a thread pool, it's just a different API. Until both GDAL and rasterio explicitly support this, you
|
By
...
· #478
·
|
|
window from_bounds behaviour
Hey Tom, rasterio windows are constructed at a specific resolution, so you need to supply a transform to use. It is usually easiest to use the transform of the raster you want to use the window on. So
Hey Tom, rasterio windows are constructed at a specific resolution, so you need to supply a transform to use. It is usually easiest to use the transform of the raster you want to use the window on. So
|
By
...
· #404
·
|
|
Representing many raster files as one big file
Hey Sean, as far as I know, this is not possible with "just" rasterio. But there is one thing you can do. GDAL (the library rasterio is built upon) supports building virtual datasets (https://gdal.org
Hey Sean, as far as I know, this is not possible with "just" rasterio. But there is one thing you can do. GDAL (the library rasterio is built upon) supports building virtual datasets (https://gdal.org
|
By
...
· #369
·
|
|
Occasional "not recognized as a supported file format" errors when reading from S3
Hey Sean, I don't know if you've seen our update on the rasterio issue tracker: https://github.com/mapbox/rasterio/issues/1686#issuecomment-541737735 As it turns out, `GDAL_DISABLE_READDIR_ON_OPEN=EMP
Hey Sean, I don't know if you've seen our update on the rasterio issue tracker: https://github.com/mapbox/rasterio/issues/1686#issuecomment-541737735 As it turns out, `GDAL_DISABLE_READDIR_ON_OPEN=EMP
|
By
...
· #339
·
|
|
Flaw in rasterio design?
There are some libraries that try and implement a raster datatype, which rasterio explicitly does not. Strangely, none of them is as successful as rasterio. I see rasterio as a tool to get the job don
There are some libraries that try and implement a raster datatype, which rasterio explicitly does not. Strangely, none of them is as successful as rasterio. I see rasterio as a tool to get the job don
|
By
...
· #333
·
|
|
Flaw in rasterio design?
Hey Amine, usually there are enough functions to allow you to have your cake and eat it, too. Instead of reproject, I usually find myself using a VRT. An alternative to mask that returns an ndarray is
Hey Amine, usually there are enough functions to allow you to have your cake and eat it, too. Instead of reproject, I usually find myself using a VRT. An alternative to mask that returns an ndarray is
|
By
...
· #331
·
|
|
MemoryFile workflow - should closing a dataset close the memfile?
You can use [contextlib.ExitStack](https://docs.python.org/3/library/contextlib.html#contextlib.ExitStack) in situations like these to save indentation levels (or enter multiple contexts in a comprehe
You can use [contextlib.ExitStack](https://docs.python.org/3/library/contextlib.html#contextlib.ExitStack) in situations like these to save indentation levels (or enter multiple contexts in a comprehe
|
By
...
· #279
·
|
|
problem with window sizes when parallelizing a funciton
As I mentioned, the canonical way to do this is to leverage functools.partial. For example: from functools import partial from concurrent.futures import ProcessPoolExecutor def worker_function(x, arg1
As I mentioned, the canonical way to do this is to leverage functools.partial. For example: from functools import partial from concurrent.futures import ProcessPoolExecutor def worker_function(x, arg1
|
By
...
· #243
·
|
|
problem with window sizes when parallelizing a funciton
Hey Javier, this is not really a rasterio problem, mostly a Python peculiarity. In general, you cannot pass functions defined in a local closure to a different process. Just move your main function to
Hey Javier, this is not really a rasterio problem, mostly a Python peculiarity. In general, you cannot pass functions defined in a local closure to a different process. Just move your main function to
|
By
...
· #241
·
|
|
Occasional "not recognized as a supported file format" errors when reading from S3
Hey Sean, thank you very much for the detailed assessment. I think this already sheds some light on some of the problems. To answer your questions: - The /vsis3/ identifiers are correct and work most
Hey Sean, thank you very much for the detailed assessment. I think this already sheds some light on some of the problems. To answer your questions: - The /vsis3/ identifiers are correct and work most
|
By
...
· #230
·
|
|
Occasional "not recognized as a supported file format" errors when reading from S3
We've only tried rasterio wheels.
We've only tried rasterio wheels.
|
By
...
· #228
·
|
|
Occasional "not recognized as a supported file format" errors when reading from S3
Dear rasterio group, (I initially posted this at https://github.com/mapbox/rasterio/issues/1686) Lately, we have encountered a strange bug in Terracotta. It basically always leads to errors like these
Dear rasterio group, (I initially posted this at https://github.com/mapbox/rasterio/issues/1686) Lately, we have encountered a strange bug in Terracotta. It basically always leads to errors like these
|
By
...
· #225
·
|