mltrace
mltrace copied to clipboard
loglabs
Coarse-grained lineage and tracing for machine learning pipelines.
### Type of change - Security fixes - Minor code change ### Description **What does this PR do?** * On running `yarn audit` there are currently 116 vulnerabilities, this PR...
### This PR: - originally, the input & output IOPointer in componentRun retrieved from history class are storing a hash value of the value - now, the original input &...
Users may want to create components like: ```python class Preprocessing(Component): def __init__(self, ...): super().__init__(...) def beforeRun(self, **kwargs): # how to give users access to history? # self.history.inputs["df"][-1] ?? # historical_inputs...
One of the bottlenecks in scaling `MLTrace` occurs when there is a large stream of requests. One of the ways to achieve this is by asynchronously writing the entries to...
@Boyuan-Deng is getting this warning when running examples client-side: ``` util.warn( /home/boyuan/anaconda3/envs/py39/lib/python3.9/site-packages/sqlalchemy/orm/relationships.py:3435: SAWarning: relationship 'Label.labels' will copy column io_pointers.value to column labels_io_pointers.io_pointer_value, which conflicts with relationship(s): 'IOPointer.io_pointers' (copies io_pointers.value to...
Related to #241 We currently have 2 tables for outputs and feedback. We also need to create materialized views of the joined tables, one for each metric with its corresponding...
We want to monitor ML pipelines to see when things might be going wrong. We need a way to encode "SLAs" into mltrace, then monitor outputs and metrics to make...
We want to track information flow throughout a pipeline at a user-defined label granularity. The user will specify labels on some inputs (i.e., the most upstream input), and we must...
In test methods, we want users to be able to compute distance metrics between current and historical data.
Reproduce the bug: 1. Landing in the home page 2. Click a component run 3. Click back button on the top left corner and you should expect either a blank...