astroPT

astroPT copied to clipboard

sogolsnj

We will need to add the Jetformer logic to the main AstroPT branch next. Lots of merging 🥲

Smith42

Right now we need to re-tokenise the incoming data before it hits the model. Much better to have it included a la HF tokenisers.

Smith42

LLM backbone integration

1

Smith42