Version Conflict: torch>=2.5.1 requirement conflicts with flashinfer wheel from torch2.4

[jlmaoju]

🐛 Describe the bug

There appears to be a version conflict in the installation requirements:

1. The project requires torch>=2.5.1 in its dependencies
2. However, the installation guide directs users to install flashinfer from: https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/

This creates a dependency conflict as:

• The flashinfer wheel from torch2.4 directory requires torch==2.4.*
• But the project itself requires torch>=2.5.1

This makes it impossible to satisfy both requirements simultaneously. Could you please:

1. Either update the flashinfer wheel location to a version compatible with torch 2.5.1+
2. Or adjust the torch version requirement to match the available flashinfer wheels
3. Or provide clear guidance on how to resolve this version conflict

Environment:

• OS: Ubuntu (WSL)
• Python: 3.11
• Installation method: Following README instructions

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.

olmocr 0.1.58 requires torch>=2.5.1, but you have torch 2.4.1 which is incompatible.

Versions

Python 3.11.11 annotated-types==0.7.0 anyio==4.8.0 beaker-py==1.34.1 bleach==6.2.0 boto3==1.37.4 botocore==1.37.4 cached_path==1.6.7 cachetools==5.5.2 certifi==2025.1.31 cffi==1.17.1 charset-normalizer==3.4.1 cryptography==44.0.2 docker==7.1.0 filelock==3.17.0 fsspec==2025.2.0 ftfy==6.3.1 google-api-core==2.24.1 google-auth==2.38.0 google-cloud-core==2.4.2 google-cloud-storage==2.19.0 google-crc32c==1.6.0 google-resumable-media==2.7.2 googleapis-common-protos==1.68.0 h11==0.14.0 httpcore==1.0.7 httpx==0.28.1 huggingface-hub==0.27.1 idna==3.10 Jinja2==3.1.5 jmespath==1.0.1 lingua-language-detector==2.0.2 markdown-it-py==3.0.0 markdown2==2.5.3 MarkupSafe==3.0.2 mdurl==0.1.2 mpmath==1.3.0 networkx==3.4.2 numpy==2.2.3 nvidia-cublas-cu12==12.4.5.8 nvidia-cuda-cupti-cu12==12.4.127 nvidia-cuda-nvrtc-cu12==12.4.127 nvidia-cuda-runtime-cu12==12.4.127 nvidia-cudnn-cu12==9.1.0.70 nvidia-cufft-cu12==11.2.1.3 nvidia-curand-cu12==10.3.5.147 nvidia-cusolver-cu12==11.6.1.9 nvidia-cusparse-cu12==12.3.1.170 nvidia-cusparselt-cu12==0.6.2 nvidia-nccl-cu12==2.21.5 nvidia-nvjitlink-cu12==12.4.127 nvidia-nvtx-cu12==12.4.127 -e git+https://github.com/allenai/olmocr.git@701abdb95525dbbfe75c2fc288df90bbea080043#egg=olmocr orjson==3.10.15 packaging==24.2 pillow==11.1.0 proto-plus==1.26.0 protobuf==5.29.3 pyasn1==0.6.1 pyasn1_modules==0.4.1 pycparser==2.22 pydantic==2.10.6 pydantic_core==2.27.2 Pygments==2.19.1 pypdf==5.3.0 pypdfium2==4.30.1 python-dateutil==2.9.0.post0 PyYAML==6.0.2 regex==2024.11.6 requests==2.32.3 rich==13.9.4 rsa==4.9 s3transfer==0.11.3 safetensors==0.5.3 sgl-kernel==0.0.3.post1 six==1.17.0 smart-open==7.1.0 sniffio==1.3.1 sympy==1.13.1 tokenizers==0.21.0 torch==2.5.1 tqdm==4.67.1 transformers==4.49.0 triton==3.1.0 typing_extensions==4.12.2 urllib3==2.3.0 wcwidth==0.2.13 webencodings==0.5.1 wrapt==1.17.2 zstandard==0.23.0