torch-mlir icon indicating copy to clipboard operation
torch-mlir copied to clipboard

publish torch-mlir binaries to PyPi

Open powderluv opened this issue 3 years ago • 4 comments

Now that the CI is mature we can turn on auditwheel in the nightly builder and publish to PyPi. Someone with admin rights (@silvasean or @dellis23 or @stellaraccident ) will have to put in the PyPI API key in as a Github secret and it is only a few lines of code to add to the release builder.

powderluv avatar Sep 30 '22 16:09 powderluv

@dellis23 was going to take a look at this!

silvasean avatar Oct 04 '22 14:10 silvasean

Okay, we have a pypi token as a github actions secret (PYPI_API_TOKEN). Do you want to add it to the release builder @powderluv since you're more familiar with that process? If not, I can look into it.

dellis23 avatar Oct 04 '22 16:10 dellis23

Please do since I wont be able to test end to end without PyPi access. I think this https://github.com/marketplace/actions/pypi-publish would help.

We will have to uncomment this line to run audit_wheel:

https://github.com/llvm/torch-mlir/blob/eda18e351c7f0a45dd78bf8fc43efb570301c3b3/build_tools/python_deploy/build_linux_packages.sh#L145

powderluv avatar Oct 04 '22 18:10 powderluv

Alright, I've made a lot of progress on this, but I've hit a snag we'll probably have to discuss together:

WARNING  Error during upload. Retry with the --verbose option for more details. 
ERROR    HTTPError: 400 Bad Request from https://upload.pypi.org/legacy/        
         File too large. Limit for project 'torch-mlir' is 100 MB. See          
         https://pypi.org/help/#file-size-limit for more information.     

See here. It looks like the file is 216.6 MB.

dellis23 avatar Oct 14 '22 19:10 dellis23