Nave Assaf

NVIDIA

Results 9 comments of


                                            Nave Assaf

Repeated outputs for long input tasks on Llama 3 70B compared to vLLM and HF's transformers

Closing due to inactivity. @DreamGenX , feel free to reopen/create a separate issue if the problem persist with the changes @netanel-haber suggested.

feat: allocate minimal blocks per window size

/bot run

feat: allocate minimal blocks per window size

/bot run

feat: allocate minimal blocks per window size

/bot run --disable-fail-fast

feat: allocate minimal blocks per window size

/bot run

feat: allocate minimal blocks per window size

/bot run

feat: allocate minimal blocks per window size

/bot run

feat: allocate minimal blocks per window size

/bot run --disable-fail-fast

feat: Add LoRA support for gemma

/bot run