Clay

icon indicating a website link https://clay-atlas.com icon indicating an email [email protected]

icon location Taipei icon location I’m passionate about reading, playing video games, and exploring ideas about the world and AI. I’m always curious about how we can push the boundaries of tech

Results 2 issues of Clay

Refactor unit tests to use standard unittest assertion methods

5 comment

# What does this PR do? This PR updates the unit tests in the repository by replacing direct assertions with `unittest` assertion methods. The purpose is to standardize the testing...

Enable FlashInfer support encoder models and add head_dim padding workaround

## Motivation This PR aims to enhance the FlashInfer attention backend in SGLang to address two primary goals: 1. **Enable support for encoder-only models**: Currently, the FlashInfer backend needs adjustments...