Neville Li

Match magnolify-tensorflow behavior w.r.t. nested types

1

Magnolify flattens nested types as `"field_a.field_b"`. Need to think about how we handle this here.

Need to implement `SequenceExample` mapping https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/example/example.proto#L184

Make sure schema mapping complies with _conformant_ convention. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/example/example.proto#L78

Fix more deprecated Parquet API usage

3

## Description > Is this change a fix, improvement, new feature, refactoring, or other? Fix more deprecated Parquet API usage: - `Binary` - `ColumnChunkMetadata` - `ColumnDescriptor` - `Statistics` > Is...

Fix deprecated Parquet OriginalType

4

## Description > Is this change a fix, improvement, new feature, refactoring, or other? Replace deprecated Parquet `OriginalType` with `LogicalTypeAnnotation` > Is this a change to the core query engine,...

Double check / refine post execution hooks

1

Something to execute after `sc.run()` with `ScioContext` & `PipelineResult`, for integration hooks i.e. submitting counters to a dashboard, lineage, or updating Bigtable cluster.

Move `AvroType` to separate sub-projects

4

To make ways for Scala 3 migration.