superduper
superduper copied to clipboard
[QUEUES] Allow jobs created on `Component` creation to be passed onto downstream components
- Compute features
- Train PCA on finished computed features
- Compute dimension reduced features
class DimReduceModel(Model):
trainer: ...
upstream: ...
listener1 = Listener(features_model, ...)
dim_reduce_model = DimReduceModel(trainer=PCATrainer(), upstream=[listener1])
listener2 = Listener(dim_reduce_model, ...)
Explanation
- The
listener1
creates features -
dim_reduce_model
trains on those features -
listener2
creates features after the training is complete