data-centric topic

Low-code framework for building custom LLMs, neural networks, and other AI models

ludwig-ai

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop....

activeloopai

DataCLUE: 数据为中心的NLP基准和工具包

CLUEbenchmark

An observer is a wrapper over JSON data, that provides an interface to know when data is changed, with a focus on performance and memory efficiency.

Maksims

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...

lancedb

From local functions to cloud deployed pipelines

stoney95

Codes for a Top 5% finish in the Data-Centric AI Competition organized by Andrew Ng and DeepLearning.AI

kennethleungty

A curated, but incomplete, list of data-centric AI resources.

daochenzha

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

encord-team

Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information"

minnesotanlp