Louis Wang

out proj weight typo fix

3

Here is a typo for initialize_parameter() function. The `output_proj.weight` should be `output_proj_weight` https://github.com/openai/CLIP/blob/dcba3cb2e2827b402d2701e7e1c7d9fed8a20ef1/clip/model.py#L321

The previous comment suggested only 1 scheduler process existed, which was misleading. In reality, world_size scheduler processes are spawned (one per TP rank/GPU), but only the primary rank sends an...

Adds platform-specific virtual environment activation instructions for Windows users. Changes: - Added Windows PowerShell activation command (.venv\Scripts\activate) - Added Windows Command Prompt activation command (.venv\Scripts\activate.bat) - Separated installation steps for...

[Feature] Add top_p and top_k sampling support

2

**Summary** Implements top_k and top_p (nucleus) sampling to enable diverse and controlled text generation in Mini-SGLang. This addresses the TODO items in api_server.py for supporting additional sampling parameters and brings...

## Summary - Improve error handling in Engine initialization - Add better error messages for debugging - Fix page_size configuration usage - Add documentation for helper functions ## Changes 1....

Add AVX2 SIMD optimization for radix tree key comparison

1

# Add AVX2 SIMD optimization for radix tree key comparison ## Summary This PR implements AVX2 SIMD instructions to accelerate the `fast_compare_key` function in the radix tree implementation, providing significant...