Scott Roy
Scott Roy
@csc010228 what is the status on the issue?
As far as prioritizing this appropriately, I thought I'd mention that coremltools can produce pre-compiled models when run from Mac, but not when run from Linux. Using pre-compiled models can...
The required work for OSS is probably creating a cmake target similar to this buck one: https://github.com/pytorch/executorch/blob/bf272de13f936628c895d4723d07f3296ace0366/backends/apple/coreml/TARGETS#L61
@YifanShenSZ @cymbalrush can you have a look?
@prmaynard are you still working on this? If not, we'd like to return it to the pool.
@Jack-Khuu adding you here to gauge your thoughts on integration of the new torchao kernel's in torchchat's quantization API (also added you on the torchao diff D62394341). Some clean up...
> Let me know if you need help with refactoring or integrating this into torchchat I'll add you as a reviewer on the integration PRs. Hopefully they will be ready...
Summarizing offline convo: * cache all of et-build * Do something like "basically python setup.py bdist_wheel -d /path/to/wheel-out-cache-dir/" cc @dbort @larryliu0820
A couple things: * On promoting experimental out of experimental, I'd like to start with the experimental/quant_apis this half. There is a larger discussion around libtorch-agnostic that I'd like to...
> A couple things: > > * On promoting experimental out of experimental, I'd like to start with the experimental/quant_apis this half. There is a larger discussion around libtorch-agnostic that...