PaLM-jax icon indicating copy to clipboard operation
PaLM-jax copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains
→

Metadata

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

Results 3 PaLM-jax issues
Sort by recently updated
recently updated
newest added

question about vmap

Hi lucidrains: Thanks for your awesome work. This is not an issue about the code, I just want to ask - did you intentionally build the model this way that...

yiyixuxu avatar yiyixuxu

Equinox fails with deprecated message

PaLM train.py fails to run with latest equinox. ![image](https://github.com/lucidrains/PaLM-jax/assets/14943401/dcb26fd7-d1cc-42ee-89a0-871c023e1280)

jojivk73 avatar jojivk73

Vmap is required

In linux based or M1 based environment we need VMAP for Palm-jax

naveens01 avatar naveens01

← Metadata

185
Stars
12
Forks
Watchers

Owner

verified publisher icon lucidrains

Metadata

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

Back