pyvo icon indicating copy to clipboard operation
pyvo copied to clipboard

Documentation: expand user guide on asynchronous queries

Open stargaser opened this issue 5 years ago • 1 comments

Some items are missing from the user guide for Jobs (async queries).

  • the run_async which does run, wait and fetch_result
  • for a very large query result, it can be better to use wget or curl to fetch the result outside of your python session
  • when using in a notebook, it can be helpful to print the job url and open that in a separate web browser tab. That result shows more details of what is happening than what pyvo.dal.TAPService provides
  • may want to note that astropy.io.votable has performance issues when reading in a large result
  • some services truncate their synchronous results but not the async ones. For this reason, NAVO has been recommending users to use run_async even for small query results.

stargaser avatar Jan 29 '20 19:01 stargaser

@stargaser WRT the last point, does your storage system where the job results go allow you to stream them out as they come in? Ours doesn't and a downside of that is that length feedback loop. One can't tell whether the query results look OK or need further tweaking of the query...

andamian avatar Jan 29 '20 20:01 andamian