Jeff Rasley

icon indicating a website link https://rasley.io icon indicating an email [email protected]

icon company @snowflakedb icon location Seattle, WA icon location @SnowflakeDB AI Research Team, DeepSpeed co-founder. Other GH account: @sfc-gh-jrasley

Results 84 comments of Jeff Rasley
trafficstars

Bing BERT

Hi @Rachnas and @tomekrut, we have uploaded our pre-processing script for the raw bookcorpus and wikipedia datasets to get them into our numpy compatible format. We haven't written up a...

Step1 training failed

Can you share more of the stack trace this is coming from? The hipconfig makes me think this is AMD but your nvidia-smi implies you're running on nvidia?

Support for FLAN-T5

Also keep an eye on this PR, it’s currently a work in progress for better T5 support: https://github.com/microsoft/DeepSpeed/pull/2451

[BUG] RuntimeError: Ninja is required to load C++ extensions

Do you have `ninja` installed? The command from pytorch that is raising this RuntimeError is attempting to run `ninja --version`. Does this command work for you?