Shrikar Archak comments

Repositories
Issues
Comments

Results 3 comments of


                                            Shrikar Archak

Example for invoking MLeap runtime in python?

Falcon 7B fails on 16GB memory with OOM

Tried with the least possible configs. ```batch_size = 16 / devices micro_batch_size = 1 # set to 2 because this is fit into 12GB Vram gradient_accumulation_iters = batch_size // micro_batch_size```

Fix type error in TFTransformer example in README

Hitting the same issue any plans on merging this?