pyvo
pyvo copied to clipboard
Documentation: expand user guide on asynchronous queries
Some items are missing from the user guide for Jobs (async queries).
- the
run_asyncwhich doesrun,waitandfetch_result - for a very large query result, it can be better to use wget or curl to fetch the result outside of your python session
- when using in a notebook, it can be helpful to print the job url and open that in a separate web browser tab. That result shows more details of what is happening than what
pyvo.dal.TAPServiceprovides - may want to note that
astropy.io.votablehas performance issues when reading in a large result - some services truncate their synchronous results but not the async ones. For this reason, NAVO has been recommending users to use
run_asynceven for small query results.
@stargaser WRT the last point, does your storage system where the job results go allow you to stream them out as they come in? Ours doesn't and a downside of that is that length feedback loop. One can't tell whether the query results look OK or need further tweaking of the query...