sdap-nexus icon indicating copy to clipboard operation
sdap-nexus copied to clipboard

Sdap 268: asynchronous request management

Open tloubrieu-jpl opened this issue 4 years ago • 1 comments

  1. added the fair scheduling option in spark (tested on podaac-devk8s, one big request launched first, small request second, second result comes first, see test code https://github.com/tloubrieu-jpl/sdap_nexus_tests/)

  2. added NexusHandlerManager to manage different end-points for a single algorthim. The demonstrate that with:

    • legacy end-points
    • rest end point (for the Spark, for example /TimeAvgMapSpark --> /algorithms/TimeAvgMap )
  3. add asynchronous management on the API, after given time (hard code for now), request sends back 202 status and a job id. The job status and eventually the job result can be found from url /jobs/<job_id>

The webapp docker image is available on https://hub.docker.com/repository/docker/tloubrieu/nexus-webapp

  1. asynchronous parameters (time out, cleaning period and request validity period) are still hard coded.

tloubrieu-jpl avatar Aug 11 '20 20:08 tloubrieu-jpl