tasking-manager
tasking-manager copied to clipboard
Add Project Data Quality view
Is your feature request related to a problem? Please describe. There's no way to way to monitor mapping in near real-time, highlighting quality issues at the same time.
Describe the solution you'd like Integrate Underpass Data Quality Tools and using Underpass UI components.
Describe alternatives you've considered Another alternative could be to develop this feature for Tasking Manager only, but there's no way currently of getting data and analyze it every minute without using Underpass. Also this could be done without using Underpass DB/REST API and/or Underpass UI, and develop new endpoints or a new UI, but this components already exists because they are intended to be used on other projects.
Additional context
There were several discussions for the design of this idea:
- https://github.com/hotosm/tasking-manager/discussions/5617
- https://github.com/hotosm/tasking-manager/discussions/5685
Finally, we arrived to the conclusion that creating a live monitoring tool, while displaying automatically detected data quality issues, have higher value than other options.
This is the draft design for the view:
It could be modified when doing the final implementation.
Technical notes
- It will be available for 4 countries (1 per Hub) in the first version, in order to have time for testing and improvement
- Should be located in:
components/projectDataQuality.js
- It will be implemented using Underpass React UI components, including the connection with an Underpass API for getting data
- It will need need access to some data for the TM project:
id
,areaOfInterest
andmappingTypes
for filtering results.
I added the view in this branch:
https://github.com/hotosm/tasking-manager/tree/feature/liveMonitoring
Hi @emi420 are we fetching data in certain intervals? Cause we don't have web socket integration right now to get the realtime data right ?
Hey @varun2948 , yes, when the "live" function is checked. I'll add websockets soon to the API and the UI (https://github.com/hotosm/underpass-ui)
Sounds great with the websocket implementation and realtime data.
We're building an approach to use gRPC instead of websockets. https://hotosm.github.io/tm-admin/communication/
From discussion today, we will include this feature only in expert mode
. Once a new PR is up from @emi420, @royallsilwallz will implement the changes to support the view for expert mode features.
https://github.com/hotosm/tasking-manager/pull/6151 will be closed soon due to unmanageable conflicts.
cc @dakotabenjamin @manjitapandey
Related PR: https://github.com/hotosm/tasking-manager/pull/6299 - @royallsilwallz you're good to pick on the next steps for expert mode integration here.
Related ticket on expert mode integration to launch this feature in experimental mode https://github.com/hotosm/tasking-manager/issues/6303
part of v4.7.2