Sean Lopp

snippets for xai bqml and looker post

1

Adding snippets from the XAI + BQML + Looker 1/24/2021 blogpost

consider setting repo to use linux binaries from PPM

2

> Note that the very first time you submit a job to CloudML the various packages required to run your script will be compiled from source. This will make the...

- [x] Remove dbt2 - [ ] Remove DBT_PROFILES_DIR. Just place the profiles.yml in the root dbt project directory - [ ] Link resources to creating the manifest at build...

Add Airbyte

1

Add an example that uses: https://hooli-airbyte.purina.elementl.dev/ One consideration with this example is deciding how to include it such that the repository still runs locally with minimal dependencies. It may also...

v8 on Centos 8 requires extra steps

2

the current v8 rules only apply to centos 6 and 7 unfortunately it appears v8 is not supported in the centos 8 epel release http://www.lib4dev.in/info/jeroen/V8/27154014 contains instructions for workarounds

It would be great if the arrow package was buildable by RSPM and had correct instructions. This package is one that we're making a big bet on at RStudio. The...

Table IO Managers should capture column schemas with appropriate metadata tag

3

### What's the use case? Many of the IO managers will add `dataframe_columns` metadata to an asset materialization, eg https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-duckdb-pandas/dagster_duckdb_pandas/duckdb_pandas_type_handler.py#L66 In https://github.com/dagster-io/dagster/pull/20424, we standardized on using `dagster/column_schema` as the metadata...

Moving from auto materialization to automation conditions

1

The past version of hooli relied on auto-materialization policies. Primarily these policies were based on the default eager auto-materialization strategy, with some customization to prevent missing or outdated partitions from...

[DOC 364] lopp/doc-364-write-creating-dagster-code-locations

2

## Summary & Motivation This doc outlines how to add code locations. I intentionally did not cover the UI "Add code location" button or NUX: - For the NUX, the...

Incorrect imports in wandb integration

2

### Dagster version 1.8.12 ### What's the issue? One of the current examples for the weights and bias integration fails with: AttributeError: 'function' object has no attribute 'create_and_run_agent' The code...