datajoint-python
datajoint-python copied to clipboard
add mechanism to check for processing progress at schema level
Add new method progress
for the schema object, returning the populate progress for all imported/computed tables for a given schema (also accounts for reserved
, error
, ignore
jobs)
@ttngu207 Perhaps we should consider utilizing populate's progress? You should be able to call this to determine the table populate status.
@guzman-raphael , the problem with table.progress()
is that it is not taking into account entries in the jobs table (e.g. reserved
, error
, ignore
).
Right, just thinking how we can report progress consistently at the table level and the schema level.
Yeah, ideally we'd fix the .progress()
at the table level to account for reserve
, error
and ignore
jobs, but that would break backward compatibility.
We can introduce an option to return as pandas
too but have it default to the current behavior.
You mean for the new schema.progress()
to return a query expression instead of pandas dataframe?