Darcy Shen

https://spark.apache.org/releases/spark-release-3-3-0.html Three Highlights for Rikai + Support complex types for Parquet vectorized reader ([SPARK-34863](https://issues.apache.org/jira/browse/SPARK-34863)) + Provide a profiler for Python/Pandas UDFs ([SPARK-37443](https://issues.apache.org/jira/browse/SPARK-37443)) + More comprehensive DS V2 push down capabilities...

We have trouble to get Rikai work with Databricks 9.1 LTS (based on Apache Spark 3.1.2). See https://github.com/eto-ai/rikai/issues/522 And Rikai works well with Databricks 10.4 LTS (based on Apache 3.2.1).

UDT: VideoTimestamp

2

https://github.com/eto-ai/spark-video/issues/26 ``` scala scala> Int.MaxValue / (1000 * 60 * 60) val res5: Int = 596 scala> Long.MaxValue / (1000 * 60 * 60) val res7: Long = 2562047788015 ```...

Viz DSL: Apply bounding boxes to Videos

1

## UDT: TimeSeriesBoundingBox array ## DSL to append the bounding box to the video (one video) ``` python video = Video("xyz.flv") video | TimeSeriesOfBoundingBox ``` Assuming that we are processing...

Visualization: thumbnail UDF

3

I created a thumbnail UDF in spark-video [v0.0.3](https://github.com/eto-ai/spark-video/releases/tag/v0.0.3) to display thumbnails in the databricks paragraph. For now, we need to ``` sql select thumbnail(image_data(to_image("s3://pato/to/image.jpg"))) ``` which is too verbose.

Just like ``` python image | Box2d(1, 1, 10, 10) ``` We need ``` image1 + image2 ``` to concatenate two images horizontally.

Support AWS Rekognition

1

AWS Rekognition: https://aws.amazon.com/rekognition/

In #369, we implemented an extended MLflow client and added extra APIs to delete a registered model. These code should be contributed back to MLflow. With a new release of...

+ https://github.com/Oneflow-Inc/vision + https://github.com/Oneflow-Inc/oneflow

Support onnx model

2

+ Onnx Model Zoo: https://github.com/onnx/models + MLflow Onnx: https://mlflow.org/docs/latest/python_api/mlflow.onnx.html + ONNX Runtime: https://onnxruntime.ai/