notebooks
notebooks copied to clipboard
Inferentia inference notebook not working
trafficstars
# Set Pip repository to point to the Neuron repository
!pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install Neuron PyTorch
!pip install torch-neuron==1.9.1.* neuron-cc[tensorflow] sagemaker>=2.79.0 transformers==4.12.3 --upgrade
Error
Writing to /home/ec2-user/.config/pip/pip.conf
ERROR: Cannot install torch-neuron==1.9.1.2.0.318.0, torch-neuron==1.9.1.2.0.392.0, torch-neuron==1.9.1.2.0.468.0, torch-neuron==1.9.1.2.0.536.0, torch-neuron==1.9.1.2.1.7.0, torch-neuron==1.9.1.2.2.0.0, torch-neuron==1.9.1.2.3.0.0, torch-neuron==1.9.1.2.5.8.0, torch-neuron==1.9.1.2.6.5.0, torch-neuron==1.9.1.2.6.6.0 and torch-neuron==1.9.1.2.7.1.0 because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
Are you running this inside a SageMaker Studio or Notebook? If so which kernel do you use? Could be a conflict with the pytorch version