Sean Gillies
Sean Gillies
A couple data points: ## My Python 2.7 dev virtualenv It's got a lot of dev installs: ``` bash (pydotorg27)MapBox-FC:rasterio sean$ python -c "import sys;print(sys.path)" ['', '/Users/sean/code/mercantile', '/Users/sean/code/make-surface', '/Users/sean/code/Fiona', '/Users/sean/code/geojsonio.py',...
Comparing the time it takes to list entry points in a `pkg_resources` working set, I find: ## My Python 2.7 dev virtualenv ``` bash (pydotorg27)MapBox-FC:rasterio sean$ time python -c "import...
In our CLI's main function, we're making two passes over the working set to find plugins (bc two entry point groups). One would be faster. Also, we should look into...
@perrygeo hmm, not sure, I don't know if we'll really know how many bytes GDAL has buffered.
@geowurster good point. Instead of touching the block cache size, the thing for a writer to do is track the number of pixels written and flush when the `buffering` limit...
Yes, sometimes, like https://docs.python.org/3/library/io.html#io.BufferedWriter.
Decision: no buffer option, only add a flush method. According to https://gdal.org/api/python_gotchas.html#saving-and-closing-datasets-datasources, it is driver dependent and not guaranteed to do anything.
@lwasser I think that profiling `show_hist()` will show where the true bottlenecks are, but I see some hints in the code. For example, we're calling `arr.flatten()` at https://github.com/mapbox/rasterio/blob/960a906dad2a4e426387ce048a52c6e90afdcd2b/rasterio/plot.py#L251, which makes...
Yes, a PR would be great!
More discussion here: https://fiona.groups.io/g/dev/topic/96037003#37. I think this could be possible for 2.0.