Romil Shah

icon indicating a website link www.shahromil.com

icon company Amazon Web Services icon location USA icon location MS student at Northeastern University. Major in Computer Vision, Machine Learning & Algorithms. Proficient in Python, MATLAB, C++ & R.

Results 2 issues of Romil Shah

[WIP] Adding support for FP8 training

- Changes made to `train.py`, `model.py`, and `norms.py` to check if Transformer Engine can be imported for P5 instances or H100s and use FP8 for Linear and LayerNorm layers. -...

Adding LLama tokenizer and S3 streaming support

- Adding flags for seamless S3 streaming using BytesIO - Adding LLamaTokenizer for using LLama based tokenizers