Andreas Motl
Andreas Motl
Hi again, I just found the spot where @gutzbenj removed the feature and provided a rationale, at https://github.com/earthobservations/wetterdienst/pull/209#issuecomment-707385971: > I reduced functionality to a point, where MOSMIX-L data is parsed...
Hi there, in order to add my two cents, if that might be helpful on this topic: I also would recommend against adding a "hidden switchover". Instead, I propose to...
> I propose to use a streaming parser to extract information from the XML file instead of using XPath-based methods. [^1] Most probably, it should be something around `lxml.etree`. See...
Just to share some numbers. The program `mosmix_large_stream.py` (#607) just iterates all XML elements, no extraction yet. The outcome is: ~1.8 GB worth of XML, containing ~1.4 M elements, iterated...
After switching to `lxml` (1472c7a1), the numbers are even better: ``` $ time python wetterdienst/provider/dwd/mosmix/mosmix_large_stream.py MOSMIX_L_2022030215.kml Parsing KML Elements seen: 1397241 Memory used: 16015360 real 0m4.252s user 0m3.859s sys 0m0.302s...
Hi Daniel, how large is your KML file? With kind regards, Andreas.
Hi Daniel, thanks again. Are we talking `MOSMIX_L/all_stations` or `MOSMIX_L/single_stations`? Currently, with my experiments, I am looking at `MOSMIX_L/all_stations`. I tried the `pykml` module you suggested with efc6dd292029b49 but it...
Hi again, with ea6d0b2e5c27ce, I benchmarked an implementation based on Fiona and GeoPandas, following the Gist https://gist.github.com/mazzma12/0a32ce693bb42b742252caabb98519db by @mazzma12. The outcome is: ```shell $ time python wetterdienst/provider/dwd/mosmix/mosmix_large_stream.py fiona MOSMIX_L_2022030215.kml Stations...
Dear Jens, thank you for looking into this and also thanks for asking. Let me tell you a bit more about the background of the subsystem you are investigating here:...
Apparently, we can also use `DASH_URL_BASE_PATHNAME`. > `url_base_pathname` > > A local URL prefix to use app-wide. Default '/'. Both `requests_pathname_prefix` and `routes_pathname_prefix` default to `url_base_pathname`. env: `DASH_URL_BASE_PATHNAME` -- https://dash.plotly.com/reference