Scott Roy

Results 33 comments of Scott Roy

As far as prioritizing this appropriately, I thought I'd mention that coremltools can produce pre-compiled models when run from Mac, but not when run from Linux. Using pre-compiled models can...

The required work for OSS is probably creating a cmake target similar to this buck one: https://github.com/pytorch/executorch/blob/bf272de13f936628c895d4723d07f3296ace0366/backends/apple/coreml/TARGETS#L61

@YifanShenSZ @cymbalrush can you have a look?

@prmaynard are you still working on this? If not, we'd like to return it to the pool.

@Jack-Khuu adding you here to gauge your thoughts on integration of the new torchao kernel's in torchchat's quantization API (also added you on the torchao diff D62394341). Some clean up...

> Let me know if you need help with refactoring or integrating this into torchchat I'll add you as a reviewer on the integration PRs. Hopefully they will be ready...

Summarizing offline convo: * cache all of et-build * Do something like "basically python setup.py bdist_wheel -d /path/to/wheel-out-cache-dir/" cc @dbort @larryliu0820

A couple things: * On promoting experimental out of experimental, I'd like to start with the experimental/quant_apis this half. There is a larger discussion around libtorch-agnostic that I'd like to...

> A couple things: > > * On promoting experimental out of experimental, I'd like to start with the experimental/quant_apis this half. There is a larger discussion around libtorch-agnostic that...