Matthew Ding

## What changes are proposed in this pull request? See go/sweeps-eval for more context. Corresponding MAPI changes are contained in https://github.com/databricks-mosaic/mcloud/pull/4562. ## How is this tested? Added unit tests. ![Screenshot...

Add pre-tokenized Delta to MDS conversion script

1

## This PR Adds conversion script for pre-tokenized data in a Delta table. ## Testing MCLI IFT and CPT runs trained successfully.