Sandy Ryza

[spec-ify-assets-def] replace dicts inside AssetsDefinition with dict of AssetSpecs

4

## Summary & Motivation This PR is the star of the ["[spec-ify-assets-def]" stack](https://github.com/dagster-io/dagster/pulls?q=is%3Aopen+is%3Apr+author%3Asryza+%22spec-ify-assets-def%22+). It replaces all of these properties on `AssetsDefinition`: ```python _asset_deps: Mapping[AssetKey, AbstractSet[AssetKey]] _group_names_by_key: Mapping[AssetKey, str] _metadata_by_key: Mapping[AssetKey,...

## Summary & Motivation ## How I Tested These Changes

## Summary & Motivation - Adds a `specs: Sequence[AssetSpec]` argument to the `AssetsDefinition` constructor. - Removes all the `_by_key` arguments from `AssetsDefinition.dagster_internal_init`, and updates all the callsites accordingly. The direction...

Respect backfill policies in auto-materialize

3

When a `BackfillPolicy` is set on an asset that allows combining multiple partitions into a single run, and auto-materialize determines that it's time to materialize multiple contiguous partitions of that...

## Summary & Motivation Whenever I go to the definition of "AssetSpec" in my editor, this comes up. Renaming it to avoid the collision with the dagster class. ## How...

Blueprint and load_defs_from_yaml

1

## Summary & Motivation ## How I Tested These Changes

RFC: `Definitions.get_all_asset_specs`

2

## Summary & Motivation One of the requests that has been coming up in catalog-related user research is the ability to enforce metadata completeness at CI time. E.g. "ensure all...

RFC: YamlBlueprintsLoader and blueprints CLI

1

## Summary & Motivation Enables defining `YamlBlueprintsLoader` objects at module scope. In addition to having a `load_defs` method, a `YamlBlueprintsLoader` serves as a declaration that the files in a particular...

To reproduce: ```python from dagster import AssetChecksDefinition, asset_check, load_asset_checks_from_current_module @asset_check(asset="asset1") def check1(): ... assert isinstance(check1, AssetChecksDefinition) asset_checks = load_asset_checks_from_current_module(asset_key_prefix=["prefix1"]) assert isinstance(asset_checks[0], AssetChecksDefinition) ``` This is because `load_asset_checks_from_current_module` calls `_checks_with_attributes` ,...

s3_pickle_io_manager does not work with dynamic outputs

1

https://dagster.slack.com/archives/C01U954MEER/p1642163479382400: Hi, I'm experiencing a bug when trying to write an ALS model from pyspark.ml.recommendation to S3 and reading it back in if this takes place within a dynamically executed...