wetterdienst
wetterdienst copied to clipboard
earthobservations
Hello from Wetterdienst
Dear @gutzbenj and @meteoDaniel,
first things first: We would like to salute you for conceiving the best-in-class DWD CDC data access library for Python. You are doing an excellent job here.
Now, let me give you a short background about us: We are a small group of like-minded people [1] interested in meteorological data. Based on the tremendous work coming from @wetterfrosch, we operate a data acquisition server for the community with beautiful visualizations in Grafana [2] which might also spark your interest ¹.
While the data processing machinery there is still based on some quickly ramped up bash programs, we took the chance to take over development of dwd-weather [3] by @marians and contributors on our journey and continued the development within dwdweather2 [4,5].
As dwdweather2 is still based on ancient Python technologies, we have been very much looking forward to throw out the underpinnings and replace them through a solid framework based on Pandas. Thankfully, @jlewis91 already started working on that within his dwdbulk [6] implementation the other day.
Now, after discovering your library, this leaves absolutely nothing to wish for. So, we would like to abandon the dwdweather2 library in the long run and look forward to base our work upon the comprehensive work you are doing here.
Saying this, we discovered some spots in the code base we would like to put some humble effort in and hope that you might like our contributions. Especially, #21 and #49 resonated very much with us ².
Cheers and keep up the spirit, Andreas.
[1] https://community.panodata.org/ [2] https://weather.hiveeyes.org/ [3] https://github.com/marians/dwd-weather [4] https://github.com/panodata/dwdweather2 [5] https://pypi.org/project/dwdweather2 [6] https://github.com/jlewis91/dwdbulk
¹ Just press "ESC" and discover more dashboards by exploring the respective list in the upper left corner.
² ... so, based on that, we already started hacking on a cli.py module in order to bring the functionality of python_dwd to the command line. While doing that, we discovered some minor quirks at some ends but we will create different issues/pull requests for them in order not to hijack/clutter this round of introduction and the conversation which might arise from here.
Dear @amotl , thank you for this kind message! As I have stated in the repository description, the original reason for this library was rather a project to learn with. However when @meteoDaniel joined the project we could lift this library together to a decent state. We appreciate any impact by others whether it be PRs or Issues or simple feature requests.
In the process of improving the library, would you rather like to join the "official" contributors or instead continue dropping PRs every now and then?
So far the best, Benjamin
Hey @amotl @gutzbenj! Nice to see there are a number of German weather fans here on github. Would you be interested in having a Google Hangout at some point in time to talk about each of our individual aims with the weather data and whether (haha) we can identify common goals we could join forces on?
Hey @jlewis91 ,
that'd be a good icebreaker ! I'm in, just give me a date + time. @meteoDaniel how about you?
I would be in, too. I would prefer some WebRTC/Jitsi. We're talking about 18:30 MEST?
@wetterfrosch can you setup the jitsi session? I guess 6:30pm Berlin time.
I suggest ("dummy-esk") http://meet.jit.si/pyhon_dwd as a WebRTC/Jitsi-meeting-place.
If this one struggles, I'll suggest an alternative. Please use a Chromium/non-Firefox-Browser, as far as I know some issues with Firefox might (still) exist.
correct my self: meet.jit.si seems to work!
I suspect that this server has issues (at least a test with two differently connected clients right now fails), but this one seems better: https://treff.fmt32.net/python_dwd
@wetterfrosch and me are currently in -- http://meet.jit.si/python_dwd. I am using Chromium Version 80.0.3950.0.
@All I am very happy to hear that there is a lot of interest in @gutzbenj projects that I have joined a while ago. I had a lot of trouble the last weeks. So I am sorry to not participate in this discussion here.
I would also like to invite @JohannesRol (dwdopendata, see also https://github.com/JohannesRol/dwdopendata/issues/1) and @FL550 (simple_dwd_weatherforecast) to this discussion. I appreciate your efforts in doing similar things with DWD Open Data as we are doing here. Don't be shy to get back to us if you like.
Hello to all! Nice project you are making here. I needed my component simple_dwd_weatherforecast as I am working on an implementation of DWD weather into home-assistant. Therefore I only need the limited data I am extracting now. The meaningful names @amotl mentioned in another post are also mapped to fit home-assistant.
As I am done with the integration I might come back and help you with this project in the future.
Wow, what a coincidence. I was exploring what data the DWD offers and stumbled upon your project.
Hello everyone. I'm a dev of the open-source Kodi Media Center (Kodi.tv). We've had our highs and lows with previous weather data services, so I figured the DWD would make a better candidate.
I want a Kodi extension so that our users can fetch current radar/satellite maps and forecasts. It seems to me that simple_dwd_weatherforecast of @FL550 is exactly what I need, but I'll monitor your project nevertheless.
Keep up the good work!
Thanks guys, we'll try to cover all the important data offered by DWD and will steadily develop towards this goal over the next weeks/months.
Nice package and discussion! Sorry for being late to the party!
We at wradlib only load current DWD radar data in our example notebooks via a quite simple http-request, no fancy stuff. RADOLAN data is expected to be downloaded by the user beforehand.
I'm thinking about adding wetterdienst as optional (for the beginning) dependency to wradlib and use it to retrieve RADOLAN and HDF5 radar data from the DWD opendata server. How complex do you think (@gutzbenj, @meteoDaniel, @amotl) is implementing the HDF5 radar data retrieval?
Hey @kmuehlbauer nice to hear from you! We can open another issue. Actually I am having all the stuff implemented locally for my own business but I am pretty sure that this can be done more advanced. So give me some time to start a first implementation.
@meteoDaniel Nice to see you around, too! I'll open a new issue regarding the HDF5 radar data. Looking forward to testing that.
Dear @difu, @EduardRosert, @coder4code, @AlexandrosBouras, @bjoern-reetz and all others from @DeutscherWetterdienst,
we just now stumbled across your organization on GitHub at [1]. We appreciate very much that the DWD is also publishing open source software on this space.
Saying that, we want to humbly point you towards what we are doing here. While Wetterdienst [2] already has some mileage, GribMagic [3] is also growing and somehow resonates with your GRIB2 Downloader [4].
So, we will be happy to hear back from you and eventually learn if you can make any use of the software we are conceiving here. Also, feel free to come back to us with any questions. We are also looking forward to any contributions coming from others.
With kind regards, Andreas.
cc @gutzbenj, @meteoDaniel, @wetterfrosch
[1] https://github.com/DeutscherWetterdienst [2] https://github.com/earthobservations/wetterdienst [3] https://github.com/earthobservations/GribMagic [4] https://github.com/DeutscherWetterdienst/downloader