BigScience Workshop

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

bigscience-workshop

Tools for curating biomedical training data for large-scale language modeling

bigscience-workshop

Ongoing research training transformer language models at scale, including: BERT & GPT-2

bigscience-workshop

Toolkit for creating, sharing and using natural language prompts.

bigscience-workshop

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

bigscience-workshop

bigscience-workshop

Code used for sourcing and cleaning the BigScience ROOTS corpus

bigscience-workshop

This directory gathers the tools developed by the Data Sourcing Working Group

bigscience-workshop

Tools for managing datasets for governance and training.

bigscience-workshop

Code and Data for Evaluation WG

bigscience-workshop