olmocr icon indicating copy to clipboard operation
olmocr copied to clipboard
verified publisher icon allenai

Dependency Conflicts During olmocr Installation

Open abhinavaggarwal1981 opened this issue 9 months ago • 7 comments

🐛 Describe the bug

Description:

I am encountering dependency version conflicts while attempting to install olmocr on my Ubuntu 24.04.2 machine. Despite following the provided installation instructions, I am unable to resolve the issues with the dependent library versions.

Steps Taken:

  • Installed all prerequisites as per the instructions.
  • Executed the command pip install -e . from the olmocr folder.

Issue Details:

Upon running the installation command, I receive the following dependency errors:

code

llama-index-llms-huggingface-api 0.1.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.27.1 which is incompatible.
pygpt-net 2.4.45 requires jupyter_client<9.0.0,>=8.6.3, but you have jupyter-client 7.4.9 which is incompatible.
pygpt-net 2.4.45 requires openai<1.60.0,>=1.55.1, but you have openai 1.65.1 which is incompatible.
pygpt-net 2.4.45 requires Pygments<3.0.0,>=2.18.0, but you have pygments 2.15.1 which is incompatible.
pygpt-net 2.4.45 requires pypdf<5.0.0,>=4.0.2, but you have pypdf 5.3.0 which is incompatible.
The installation process is automatically installing the latest versions of huggingface-hub and transformers, but the dependencies require earlier versions of huggingface-hub.
Successfully installed packages: huggingface-hub-0.27.1, olmocr-0.1.58, transformers-4.49.0.

Attempts to Resolve:

I tried uninstalling huggingface-hub and manually installing the required version.

However, when I re-run pip install -e ., the same dependency errors occur, and huggingface-hub updates to the latest version.

Additional Information:

I am relatively new to Python and its libraries, so I may be missing something in the process.

Request:

Could someone please review the dependency requirements and suggest any necessary updates? Alternatively, if I am making a mistake in the installation process, guidance on the correct steps would be greatly appreciated.

Thank you for your assistance.

Regards,

Abhinav Aggarwal

Versions

Python Version and Pip libraries installed in the system

$> python --version && pip freeze
Python 3.11.5
aiobotocore @ file:///croot/aiobotocore_1682536655331/work
aiofiles @ file:///croot/aiofiles_1683773582346/work
aiohappyeyeballs==2.4.4
aiohttp==3.11.10
aiohttp-cors==0.7.0
aioitertools @ file:///tmp/build/80754af9/aioitertools_1607109665762/work
aiosignal @ file:///tmp/build/80754af9/aiosignal_1637843061372/work
aiosqlite @ file:///croot/aiosqlite_1683773899903/work
airportsdata==20250224
alabaster @ file:///home/ktietz/src/ci/alabaster_1611921544520/work
altair==5.4.1
anaconda-anon-usage @ file:///croot/anaconda-anon-usage_1695305080842/work
anaconda-catalogs @ file:///croot/anaconda-catalogs_1685727283692/work
anaconda-client @ file:///croot/anaconda-client_1694625250883/work
anaconda-cloud-auth @ file:///croot/anaconda-cloud-auth_1694462071362/work
anaconda-navigator @ file:///croot/anaconda-navigator_1695236675007/work
anaconda-project @ file:///work/ci_py311/anaconda-project_1676846728333/work
annotated-types==0.7.0
anthropic==0.28.1
anyio @ file:///work/ci_py311/anyio_1676823771847/work/dist
appdirs==1.4.4
argon2-cffi @ file:///opt/conda/conda-bld/argon2-cffi_1645000214183/work
argon2-cffi-bindings @ file:///work/ci_py311/argon2-cffi-bindings_1676823553406/work
arrow @ file:///work/ci_py311/arrow_1677696236099/work
asgiref==3.8.1
astor==0.8.1
astroid @ file:///work/ci_py311/astroid_1676920975848/work
astropy @ file:///work/ci_py311_2/astropy_1679335217840/work
asttokens==2.4.1
async-timeout @ file:///work/ci_py311/async-timeout_1676826962453/work
atomicwrites==1.4.0
attrs==23.1.0
autobahn==23.6.2
Automat==22.10.0
autopep8 @ file:///opt/conda/conda-bld/autopep8_1650463822033/work
azure-core==1.32.0
azure-identity==1.19.0
Babel @ file:///work/ci_py311/babel_1676825020543/work
backcall @ file:///home/ktietz/src/ci/backcall_1611930011877/work
backoff==2.2.1
backports.functools-lru-cache @ file:///tmp/build/80754af9/backports.functools_lru_cache_1618170165463/work
backports.tempfile @ file:///home/linux1/recipes/ci/backports.tempfile_1610991236607/work
backports.weakref==1.0.post1
bcrypt==4.2.1
beaker-py==1.34.1
beautifulsoup4==4.12.3
bidict==0.23.1
binaryornot @ file:///tmp/build/80754af9/binaryornot_1617751525010/work
black @ file:///croot/black_1680737249031/work
blake3==1.0.4
bleach @ file:///opt/conda/conda-bld/bleach_1641577558959/work
blinker==1.8.2
bokeh @ file:///croot/bokeh_1690546085683/work
boltons @ file:///work/ci_py311/boltons_1677685195580/work
boto3==1.37.4
botocore==1.37.4
Bottleneck @ file:///work/ci_py311/bottleneck_1676827011612/work
branca==0.8.0
breeze-connect==1.0.58
breeze-strategies==1.0.23
brotlipy==0.7.0
build==1.2.2.post1
cached_path==1.6.7
cachetools==5.5.0
certifi==2023.5.7
cffi @ file:///work/ci_py311/cffi_1676822533496/work
chardet @ file:///work/ci_py311/chardet_1676830276092/work
charset-normalizer==3.1.0
chroma-hnswlib==0.7.3
chromadb==0.4.24
chromedriver-autoinstaller==0.6.4
click @ file:///work/ci_py311/click_1676825163161/work
cloudpickle @ file:///croot/cloudpickle_1683040006038/work
clyent==1.2.2
colorama @ file:///work/ci_py311/colorama_1676827038675/work
colorcet @ file:///work/ci_py311/colorcet_1676839173519/work
coloredlogs==15.0.1
colorful==0.5.6
comm==0.2.1
compressed-tensors==0.9.1
conda @ file:///croot/conda_1694544150384/work
conda-build @ file:///croot/conda-build_1692366767805/work
conda-content-trust @ file:///croot/conda-content-trust_1693490622020/work
conda-libmamba-solver @ file:///croot/conda-libmamba-solver_1691418897561/work/src
conda-pack @ file:///tmp/build/80754af9/conda-pack_1611163042455/work
conda-package-handling @ file:///croot/conda-package-handling_1690999929514/work
conda-repo-cli==1.0.75
conda-token @ file:///Users/paulyim/miniconda3/envs/c3i/conda-bld/conda-token_1662660369760/work
conda-verify==3.4.2
conda_index @ file:///croot/conda-index_1695310357675/work
conda_package_streaming @ file:///croot/conda-package-streaming_1690987966409/work
constantly==15.1.0
contourpy @ file:///work/ci_py311/contourpy_1676827066340/work
cookiecutter @ file:///opt/conda/conda-bld/cookiecutter_1649151442564/work
cramjam==2.8.4
croniter==2.0.7
cryptography==43.0.1
cssselect==1.1.0
cuda-bindings==12.8.0
cuda-python==12.8.0
cx_Oracle==8.3.0
cycler @ file:///tmp/build/80754af9/cycler_1637851556182/work
cytoolz @ file:///work/ci_py311/cytoolz_1676830405847/work
daal4py==2023.1.1
dask @ file:///croot/dask-core_1686782904390/work
dataclasses-json==0.6.7
datasets @ file:///croot/datasets_1684482929171/work
datashader @ file:///croot/datashader_1692372248705/work
datashape==0.5.4
debugpy==1.8.1
decorator==5.1.1
decord==0.6.0
defusedxml @ file:///tmp/build/80754af9/defusedxml_1615228127516/work
Deprecated==1.2.15
depyf==0.18.0
diff-match-patch @ file:///Users/ktietz/demo/mc3/conda-bld/diff-match-patch_1630511840874/work
dill @ file:///work/ci_py311/dill_1676827712960/work
dirtyjson==1.0.8
diskcache==5.6.3
distlib==0.3.9
distributed @ file:///croot/distributed_1686866039819/work
distro==1.9.0
docker==7.1.0
docstring-to-markdown @ file:///work/ci_py311/docstring-to-markdown_1676851973684/work
docutils @ file:///work/ci_py311/docutils_1676822773036/work
docx2txt==0.8
durationpy==0.9
EbookLib==0.18
einops==0.8.1
elastic-transport==8.15.1
elasticsearch==8.17.0
entrypoints @ file:///work/ci_py311/entrypoints_1676823319002/work
et-xmlfile==1.1.0
evdev==1.7.1
executing==2.0.1
fastapi==0.115.6
fastjsonschema @ file:///work/ci_py311_2/python-fastjsonschema_1679340124475/work
fastparquet==2024.5.0
feedfinder2==0.0.4
feedparser==6.0.11
filelock==3.17.0
finta==1.3
fire==0.7.0
flake8 @ file:///work/ci_py311/flake8_1677709235205/work
flashinfer-python==0.2.2.post1
Flask @ file:///work/ci_py311/flask_1676827140363/work
flatbuffers==24.3.25
folium==0.17.0
fonttools==4.25.0
frozenlist @ file:///work/ci_py311/frozenlist_1676825229010/work
fsspec==2024.10.0
ftfy==6.3.1
future @ file:///work/ci_py311_2/future_1679335928186/work
gensim @ file:///work/ci_py311/gensim_1677033391129/work
geopandas==1.0.1
gguf==0.10.0
gitdb==4.0.11
GitPython==3.1.43
gkeepapi==0.15.1
glob2 @ file:///home/linux1/recipes/ci/glob2_1610991677669/work
gmpy2 @ file:///work/ci_py311/gmpy2_1676839849213/work
google-ai-generativelanguage==0.6.4
google-api-core==2.24.0
google-api-python-client==2.155.0
google-auth==2.37.0
google-auth-httplib2==0.2.0
google-auth-oauthlib==1.2.1
google-cloud-core==2.4.2
google-cloud-storage==2.19.0
google-crc32c==1.6.0
google-generativeai==0.5.4
google-resumable-media==2.7.2
googleapis-common-protos==1.66.0
gpsoauth==1.1.1
greenlet==3.1.1
grpcio==1.68.1
grpcio-status==1.62.3
h11==0.14.0
h5py @ file:///croot/h5py_1691589708553/work
HeapDict @ file:///Users/ktietz/demo/mc3/conda-bld/heapdict_1630598515714/work
hf_transfer==0.1.9
holoviews @ file:///croot/holoviews_1693378042783/work
html2text==2024.2.26
httpcore==1.0.7
httplib2==0.22.0
httptools==0.6.4
httpx==0.27.2
httpx-socks==0.9.2
huggingface-hub==0.27.1
humanfriendly==10.0
hvplot @ file:///croot/hvplot_1685998166135/work
hyperlink @ file:///tmp/build/80754af9/hyperlink_1610130746837/work
idna @ file:///work/ci_py311/idna_1676822698822/work
imagecodecs @ file:///croot/imagecodecs_1695064943445/work
imageio @ file:///croot/imageio_1687264943895/work
imagesize @ file:///work/ci_py311/imagesize_1676830829500/work
imbalanced-learn @ file:///croot/imbalanced-learn_1685020884354/work
importlib_metadata==8.6.1
importlib_resources==6.4.5
incremental==22.10.0
inflection==0.5.1
iniconfig @ file:///home/linux1/recipes/ci/iniconfig_1610983019677/work
intake @ file:///work/ci_py311_2/intake_1679336472739/work
interegular==0.3.3
intervaltree @ file:///Users/ktietz/demo/mc3/conda-bld/intervaltree_1630511889664/work
ipykernel==6.29.5
ipython==8.21.0
ipython-genutils @ file:///tmp/build/80754af9/ipython_genutils_1606773439826/work
ipywidgets @ file:///croot/ipywidgets_1679394798311/work
isodate==0.6.1
isort @ file:///tmp/build/80754af9/isort_1628603791788/work
itemadapter @ file:///tmp/build/80754af9/itemadapter_1626442940632/work
itemloaders @ file:///opt/conda/conda-bld/itemloaders_1646805235997/work
itsdangerous @ file:///tmp/build/80754af9/itsdangerous_1621432558163/work
jaraco.classes @ file:///tmp/build/80754af9/jaraco.classes_1620983179379/work
jedi==0.19.1
jeepney @ file:///tmp/build/80754af9/jeepney_1627537048313/work
jellyfish @ file:///croot/jellyfish_1695193535278/work
jieba3k==0.35.1
Jinja2 @ file:///work/ci_py311/jinja2_1676823587943/work
jinja2-time @ file:///opt/conda/conda-bld/jinja2-time_1649251842261/work
jiter==0.8.2
jmespath @ file:///Users/ktietz/demo/mc3/conda-bld/jmespath_1630583964805/work
joblib @ file:///croot/joblib_1685113087166/work
json5 @ file:///tmp/build/80754af9/json5_1624432770122/work
jsonpatch==1.33
jsonpointer==2.1
jsonschema==4.23.0
jsonschema-specifications==2024.10.1
jupyter @ file:///work/ci_py311/jupyter_1676837039433/work
jupyter-console @ file:///croot/jupyter_console_1679999630278/work
jupyter-events @ file:///croot/jupyter_events_1684268042853/work
jupyter-server @ file:///work/ci_py311/jupyter_server_1676824947163/work
jupyter-ydoc @ file:///croot/jupyter_ydoc_1683747223142/work
jupyter_client @ file:///work/ci_py311/jupyter_client_1676823491351/work
jupyter_core==5.7.1
jupyter_server_fileid @ file:///croot/jupyter_server_fileid_1684273577568/work
jupyter_server_ydoc @ file:///croot/jupyter_server_ydoc_1686767404829/work
jupyterlab @ file:///croot/jupyterlab_1686179668131/work
jupyterlab-pygments @ file:///tmp/build/80754af9/jupyterlab_pygments_1601490720602/work
jupyterlab-widgets @ file:///croot/jupyterlab_widgets_1679055282532/work
jupyterlab_server @ file:///croot/jupyterlab_server_1680792501448/work
kaleido @ file:///croot/python-kaleido_1689925312296/work
keyring @ file:///croot/keyring_1678999217139/work
kiwisolver @ file:///work/ci_py311/kiwisolver_1676827230232/work
kubernetes==31.0.0
langchain==0.2.17
langchain-community==0.2.19
langchain-core==0.2.43
langchain-experimental==0.0.64
langchain-openai==0.1.25
langchain-text-splitters==0.2.4
langsmith==0.1.147
lark==1.2.2
lazy-object-proxy @ file:///work/ci_py311/lazy-object-proxy_1676827255418/work
lazy_loader @ file:///croot/lazy_loader_1687264084094/work
libarchive-c @ file:///tmp/build/80754af9/python-libarchive-c_1617780486945/work
libmambapy @ file:///croot/mamba-split_1694187754698/work/libmambapy
lingua-language-detector==2.0.2
linkify-it-py @ file:///work/ci_py311/linkify-it-py_1676837069144/work
litellm==1.61.20
llama-cloud==0.1.6
llama-index==0.10.67.post1
llama-index-agent-openai==0.2.9
llama-index-cli==0.1.13
llama-index-core==0.10.67
llama-index-embeddings-azure-openai==0.1.11
llama-index-embeddings-huggingface-api==0.1.1
llama-index-embeddings-ollama==0.2.0
llama-index-embeddings-openai==0.1.11
llama-index-indices-managed-llama-cloud==0.2.7
llama-index-legacy==0.9.48.post4
llama-index-llms-anthropic==0.1.17
llama-index-llms-azure-openai==0.1.10
llama-index-llms-gemini==0.2.0
llama-index-llms-huggingface-api==0.1.0
llama-index-llms-ollama==0.2.2
llama-index-llms-openai==0.1.31
llama-index-llms-openai-like==0.1.3
llama-index-multi-modal-llms-openai==0.1.9
llama-index-program-openai==0.1.7
llama-index-question-gen-openai==0.1.3
llama-index-readers-chatgpt-plugin==0.1.3
llama-index-readers-database==0.1.4
llama-index-readers-file==0.1.33
llama-index-readers-github==0.1.9
llama-index-readers-google==0.2.11
llama-index-readers-llama-parse==0.1.6
llama-index-readers-microsoft-onedrive==0.1.9
llama-index-readers-twitter==0.1.3
llama-index-readers-web==0.1.23
llama-index-utils-huggingface==0.1.1
llama-index-vector-stores-chroma==0.1.10
llama-index-vector-stores-elasticsearch==0.1.7
llama-index-vector-stores-pinecone==0.1.9
llama-index-vector-stores-redis==0.1.2
llama-parse==0.4.9
llvmlite @ file:///croot/llvmlite_1683555126642/work
lm-format-enforcer==0.10.11
lmdb @ file:///croot/python-lmdb_1682522346377/work
locket @ file:///work/ci_py311/locket_1676827274546/work
logzero==1.7.0
lxml @ file:///croot/lxml_1695058164555/work
lz4 @ file:///croot/lz4_1686057876374/work
Markdown==3.7
markdown-it-py @ file:///croot/markdown-it-py_1684279902645/work
markdown2==2.5.3
MarkupSafe @ file:///work/ci_py311/markupsafe_1676823507015/work
marshmallow==3.23.1
matplotlib @ file:///croot/matplotlib-suite_1693812469450/work
matplotlib-inline==0.1.6
mccabe @ file:///opt/conda/conda-bld/mccabe_1644221741721/work
mdit-py-plugins @ file:///work/ci_py311/mdit-py-plugins_1676837111662/work
mdurl @ file:///work/ci_py311/mdurl_1676827289376/work
minijinja==2.5.0
mistral_common==1.5.3
mistune==3.0.2
mizani==0.9.3
mkl-fft @ file:///croot/mkl_fft_1695058164594/work
mkl-random @ file:///croot/mkl_random_1695059800811/work
mkl-service==2.4.0
mmh3==5.0.1
modelscope==1.23.1
monotonic==1.6
more-itertools @ file:///tmp/build/80754af9/more-itertools_1637733554872/work
MouseInfo==0.1.3
mplfinance==0.12.10b0
mpmath @ file:///croot/mpmath_1690848262763/work
msal==1.31.1
msal-extensions==1.2.0
msgpack @ file:///work/ci_py311/msgpack-python_1676823037805/work
msgspec==0.19.0
mss==9.0.2
multidict @ file:///work/ci_py311/multidict_1676825314105/work
multipledispatch @ file:///work/ci_py311/multipledispatch_1676841220684/work
multiprocess @ file:///work/ci_py311/multiprocess_1676841234722/work
munkres==1.1.4
mypy-extensions @ file:///croot/mypy_extensions_1695130926492/work
mysql-connector-python==8.3.0
narwhals==1.9.4
navigator-updater @ file:///croot/navigator-updater_1695210188412/work
nbclassic @ file:///croot/nbclassic_1681756170010/work
nbclient @ file:///work/ci_py311/nbclient_1676823713954/work
nbconvert==7.16.4
nbformat @ file:///croot/nbformat_1694616755618/work
nest-asyncio==1.6.0
networkx @ file:///croot/networkx_1690561992265/work
newspaper3k==0.2.8
ninja==1.11.1.3
nltk @ file:///croot/nltk_1688114146592/work
notebook @ file:///croot/notebook_1690984815942/work
notebook_shim @ file:///work/ci_py311/notebook-shim_1676825053954/work
nsepy==0.8
numba @ file:///croot/numba_1690878269903/work
numexpr @ file:///croot/numexpr_1683221822650/work
numpy==1.26.4
numpydoc @ file:///work/ci_py311/numpydoc_1676845056742/work
nvidia-cublas-cu12==12.4.5.8
nvidia-cuda-cupti-cu12==12.4.127
nvidia-cuda-nvrtc-cu12==12.4.127
nvidia-cuda-runtime-cu12==12.4.127
nvidia-cudnn-cu12==9.1.0.70
nvidia-cufft-cu12==11.2.1.3
nvidia-curand-cu12==10.3.5.147
nvidia-cusolver-cu12==11.6.1.9
nvidia-cusparse-cu12==12.3.1.170
nvidia-cusparselt-cu12==0.6.2
nvidia-ml-py==12.570.86
nvidia-nccl-cu12==2.21.5
nvidia-nvjitlink-cu12==12.4.127
nvidia-nvtx-cu12==12.4.127
oauth2client==4.1.3
oauthlib==3.2.2
ollama==0.3.3
-e git+https://github.com/allenai/olmocr.git@701abdb95525dbbfe75c2fc288df90bbea080043#egg=olmocr
onnxruntime==1.20.1
openai==1.65.1
opencensus==0.11.4
opencensus-context==0.1.3
opencv-python==4.10.0.84
opencv-python-headless==4.10.0.84
openpyxl==3.1.5
opentelemetry-api==1.27.0
opentelemetry-exporter-otlp-proto-common==1.27.0
opentelemetry-exporter-otlp-proto-grpc==1.27.0
opentelemetry-instrumentation==0.48b0
opentelemetry-instrumentation-asgi==0.48b0
opentelemetry-instrumentation-fastapi==0.48b0
opentelemetry-proto==1.27.0
opentelemetry-sdk==1.27.0
opentelemetry-semantic-conventions==0.48b0
opentelemetry-util-http==0.48b0
orjson==3.10.12
outcome==1.3.0.post0
outlines==0.1.11
outlines_core==0.1.26
overrides==7.7.0
packaging==23.2
pandas==2.2.3
pandocfilters @ file:///opt/conda/conda-bld/pandocfilters_1643405455980/work
panel @ file:///croot/panel_1695145879546/work
param @ file:///croot/param_1684915322283/work
parsel @ file:///work/ci_py311/parsel_1676905937880/work
parso==0.8.3
partd @ file:///croot/partd_1693937863478/work
partial-json-parser==0.2.1.1.post5
pathlib @ file:///Users/ktietz/demo/mc3/conda-bld/pathlib_1629713961906/work
pathspec @ file:///work/ci_py311_2/pathspec_1679337288229/work
patsy==0.5.3
pdf2docx==0.5.8
pep8==1.7.1
pexpect==4.9.0
pickleshare @ file:///tmp/build/80754af9/pickleshare_1606932040724/work
pillow==10.4.0
pinecone-client==3.2.2
pkce @ file:///croot/pkce_1690384816590/work
pkginfo @ file:///croot/pkginfo_1679431160147/work
platformdirs==4.2.0
playwright==1.49.1
plotly @ file:///work/ci_py311/plotly_1676841625489/work
plotnine==0.12.4
pluggy @ file:///work/ci_py311/pluggy_1676822818071/work
ply==3.11
portalocker==2.10.1
posthog==3.7.4
poyo @ file:///tmp/build/80754af9/poyo_1617751526755/work
prometheus-fastapi-instrumentator==7.0.2
prometheus_client==0.21.1
prompt-toolkit==3.0.43
propcache==0.2.1
Protego @ file:///tmp/build/80754af9/protego_1598657180827/work
proto-plus==1.25.0
protobuf==4.25.5
psutil==5.9.8
ptyprocess==0.7.0
pulsar-client==3.5.0
pure-eval==0.2.2
py-cpuinfo @ file:///Users/ktietz/demo/mc3/conda-bld/py-cpuinfo_1629480366017/work
py-spy==0.4.0
pyarrow==11.0.0
pyasn1 @ file:///Users/ktietz/demo/mc3/conda-bld/pyasn1_1629708007385/work
pyasn1-modules==0.2.8
PyAudio==0.2.14
PyAutoGUI==0.9.54
pybind11==2.13.6
pycodestyle @ file:///work/ci_py311/pycodestyle_1677708783451/work
pycosat @ file:///work/ci_py311/pycosat_1676838522308/work
pycountry==24.6.1
pycparser @ file:///tmp/build/80754af9/pycparser_1636541352034/work
pycryptodome==3.20.0
pycryptodomex==3.21.0
pyct @ file:///work/ci_py311/pyct_1676838544646/work
pycurl @ file:///croot/pycurl_1686662440405/work
pydantic==2.10.6
pydantic_core==2.27.2
pydeck==0.9.1
PyDispatcher==2.0.5
pydocstyle @ file:///work/ci_py311/pydocstyle_1677708708066/work
PyDrive==1.3.1
pydub==0.25.1
pyee==12.0.0
pyerfa @ file:///work/ci_py311/pyerfa_1676838574038/work
pyflakes @ file:///work/ci_py311/pyflakes_1677708650266/work
pygame==2.6.1
PyGetWindow==0.0.9
Pygments @ file:///croot/pygments_1684279966437/work
pygpt-net==2.4.45
PyJWT @ file:///work/ci_py311/pyjwt_1676827385359/work
pylint @ file:///work/ci_py311/pylint_1676920998643/work
pylint-venv @ file:///work/ci_py311/pylint-venv_1677706395472/work
pyls-spyder==0.4.0
PyMsgBox==1.0.9
PyMuPDF==1.25.1
pynput==1.7.7
pyodbc @ file:///work/ci_py311/pyodbc_1676860985304/work
pyogrio==0.10.0
pyOpenSSL @ file:///croot/pyopenssl_1690223430423/work
pyotp==2.8.0
pyparsing==3.1.0
pypdf==5.3.0
pypdfium2==4.30.1
pyperclip==1.9.0
PyPika==0.48.9
pyproj==3.7.0
pyproject_hooks==1.2.0
PyQt5-sip==12.11.0
PyRect==0.2.0
pyrsistent @ file:///work/ci_py311/pyrsistent_1676823088752/work
PyScreeze==1.0.1
pyserial==3.5
PySide6==6.4.2
PySide6-Addons==6.4.2
PySide6-Essentials==6.4.2
PySocks @ file:///work/ci_py311/pysocks_1676822712504/work
pytest @ file:///croot/pytest_1690474690005/work
python-dateutil==2.8.2
python-docx==1.1.2
python-dotenv @ file:///work/ci_py311/python-dotenv_1676842320650/work
python-engineio==4.10.1
python-json-logger @ file:///croot/python-json-logger_1683823803357/work
python-lsp-black @ file:///work/ci_py311/python-lsp-black_1676845562358/work
python-lsp-jsonrpc==1.0.0
python-lsp-server @ file:///croot/python-lsp-server_1681930392028/work
python-markdown-math==0.8
python-multipart==0.0.20
python-slugify @ file:///tmp/build/80754af9/python-slugify_1620405669636/work
python-snappy @ file:///work/ci_py311/python-snappy_1676842365339/work
python-socketio==5.11.4
python-socks==2.5.3
python-xlib==0.33
python3-xlib==0.15
pytoolconfig @ file:///work/ci_py311/pytoolconfig_1677709006710/work
pytweening==1.2.0
pytz==2023.3
pyviz-comms @ file:///croot/pyviz_comms_1685030693726/work
PyWavelets @ file:///work/ci_py311/pywavelets_1676838693522/work
pyxdg @ file:///tmp/build/80754af9/pyxdg_1603822279816/work
PyYAML==6.0.2
pyzmq==25.1.2
QDarkStyle @ file:///tmp/build/80754af9/qdarkstyle_1617386714626/work
qstylizer @ file:///work/ci_py311/qstylizer_1677706154568/work/dist/qstylizer-0.2.2-py2.py3-none-any.whl
qt-material==2.14
QtAwesome @ file:///work/ci_py311/qtawesome_1677705159328/work
qtconsole @ file:///croot/qtconsole_1681394213385/work
QtPy @ file:///work/ci_py311/qtpy_1676827467989/work
queuelib==1.5.0
ray==2.43.0
rdflib==6.3.2
rdflib-jsonld==0.6.2
redis==5.2.1
referencing==0.36.2
regex @ file:///work/ci_py311/regex_1677086824242/work
requests @ file:///croot/requests_1690400202158/work
requests-file @ file:///Users/ktietz/demo/mc3/conda-bld/requests-file_1629455781986/work
requests-oauthlib==1.3.1
requests-toolbelt @ file:///croot/requests-toolbelt_1690874004362/work
responses @ file:///tmp/build/80754af9/responses_1619800270522/work
rfc3339-validator @ file:///croot/rfc3339-validator_1683077044675/work
rfc3986-validator @ file:///croot/rfc3986-validator_1683058983515/work
rich==13.9.2
rope @ file:///work/ci_py311/rope_1677708536193/work
rpds-py==0.23.1
rsa==4.9
Rtree @ file:///work/ci_py311/rtree_1676845693189/work
ruamel-yaml-conda @ file:///work/ci_py311/ruamel_yaml_1676845707897/work
ruamel.yaml @ file:///work/ci_py311/ruamel.yaml_1676838772170/work
s3fs @ file:///croot/s3fs_1682551471189/work
s3transfer==0.11.3
safetensors==0.4.5
scikit-image @ file:///croot/scikit-image_1682528309703/work
scikit-learn @ file:///croot/scikit-learn_1690978916802/work
scikit-learn-intelex==20230426.111612
scipy @ file:///croot/scipy_1691606680890/work/dist/scipy-1.11.1-cp311-cp311-linux_x86_64.whl#sha256=ba491c7d30a02bb93027e90b0aa58c0fe8d1e0fc3ddfe3469178740bd150aa45
Scrapy @ file:///work/ci_py311/scrapy_1677770267574/work
seaborn @ file:///work/ci_py311/seaborn_1676845747354/work
SecretStorage @ file:///work/ci_py311_2/secretstorage_1679339060489/work
selenium==4.27.1
Send2Trash @ file:///tmp/build/80754af9/send2trash_1632406701022/work
sentencepiece==0.2.0
service-identity @ file:///Users/ktietz/demo/mc3/conda-bld/service_identity_1629460757137/work
setproctitle==1.3.5
sgl-kernel==0.0.3.post6
sglang==0.4.3.post2
sgmllib3k==1.0.0
shapely==2.0.6
shellingham==1.5.4
shiboken6==6.4.2
show-in-file-manager==1.1.5
simple-websocket==1.1.0
simplejson==3.19.1
sip @ file:///work/ci_py311/sip_1676825117084/work
six==1.16.0
smart-open @ file:///work/ci_py311/smart_open_1676842848397/work
smartapi-python==1.4.8
smmap==5.0.1
sniffio==1.3.0
snowballstemmer @ file:///tmp/build/80754af9/snowballstemmer_1637937080595/work
sortedcontainers @ file:///tmp/build/80754af9/sortedcontainers_1623949099177/work
soupsieve @ file:///croot/soupsieve_1680518478486/work
SpeechRecognition==3.12.0
Sphinx @ file:///work/ci_py311/sphinx_1676842864059/work
sphinxcontrib-applehelp @ file:///home/ktietz/src/ci/sphinxcontrib-applehelp_1611920841464/work
sphinxcontrib-devhelp @ file:///home/ktietz/src/ci/sphinxcontrib-devhelp_1611920923094/work
sphinxcontrib-htmlhelp @ file:///tmp/build/80754af9/sphinxcontrib-htmlhelp_1623945626792/work
sphinxcontrib-jsmath @ file:///home/ktietz/src/ci/sphinxcontrib-jsmath_1611920942228/work
sphinxcontrib-qthelp @ file:///home/ktietz/src/ci/sphinxcontrib-qthelp_1611921055322/work
sphinxcontrib-serializinghtml @ file:///tmp/build/80754af9/sphinxcontrib-serializinghtml_1624451540180/work
spider-client==0.0.27
spyder @ file:///croot/spyder_1681934064788/work
spyder-kernels @ file:///croot/spyder-kernels_1691599531749/work
SQLAlchemy==2.0.36
stack-data==0.6.3
starlette==0.41.3
statsmodels @ file:///croot/statsmodels_1689937266057/work
streamlit==1.39.0
striprtf==0.0.26
sympy==1.13.1
ta-lib==0.6.3
tables @ file:///croot/pytables_1691621466859/work
tabulate @ file:///work/ci_py311/tabulate_1676838830728/work
TBB==0.2
tblib @ file:///Users/ktietz/demo/mc3/conda-bld/tblib_1629402031467/work
tenacity==8.5.0
termcolor==2.5.0
terminado @ file:///work/ci_py311/terminado_1677696151350/work
text-unidecode @ file:///Users/ktietz/demo/mc3/conda-bld/text-unidecode_1629401354553/work
textdistance @ file:///tmp/build/80754af9/textdistance_1612461398012/work
threadpoolctl @ file:///Users/ktietz/demo/mc3/conda-bld/threadpoolctl_1629802263681/work
three-merge @ file:///tmp/build/80754af9/three-merge_1607553261110/work
tifffile @ file:///croot/tifffile_1695107451082/work
tiktoken==0.7.0
timeframe==3.0.0
tinycss2 @ file:///work/ci_py311/tinycss2_1676823757641/work
tinysegmenter==0.3
tldextract @ file:///opt/conda/conda-bld/tldextract_1646638314385/work
tokenizers==0.21.0
toml @ file:///tmp/build/80754af9/toml_1616166611790/work
tomlkit @ file:///work/ci_py311/tomlkit_1676823218885/work
toolz @ file:///work/ci_py311/toolz_1676827522705/work
torch==2.5.1
torchao==0.9.0
torchaudio==2.5.1
torchvision==0.20.1
tornado==6.4
tqdm==4.67.1
traitlets==5.14.1
transformers==4.49.0
trio==0.24.0
trio-websocket==0.11.1
triton==3.1.0
tweepy==4.14.0
Twisted @ file:///croot/twisted_1683796889247/work
txaio==23.1.1
typer==0.15.1
typing-inspect==0.9.0
typing_extensions==4.12.2
tzdata @ file:///croot/python-tzdata_1690578112552/work
uc-micro-py @ file:///work/ci_py311/uc-micro-py_1676828889155/work
ujson @ file:///work/ci_py311/ujson_1676828903327/work
Unidecode @ file:///tmp/build/80754af9/unidecode_1614712377438/work
uritemplate==4.1.1
urllib3==1.26.20
uvicorn==0.34.0
uvloop==0.21.0
virtualenv==20.29.2
w3lib @ file:///Users/ktietz/demo/mc3/conda-bld/w3lib_1629359764703/work
watchdog @ file:///work/ci_py311/watchdog_1676846191736/work
watchfiles==1.0.3
wcwidth==0.2.13
webencodings==0.5.1
websocket-client==1.8.0
websockets==14.1
Werkzeug @ file:///croot/werkzeug_1679489717957/work
whatthepatch @ file:///work/ci_py311/whatthepatch_1677708379946/work
widgetsnbextension @ file:///croot/widgetsnbextension_1679313860248/work
wikipedia==1.4.0
wrapt @ file:///work/ci_py311/wrapt_1676827586170/work
wsproto==1.2.0
wurlitzer @ file:///work/ci_py311/wurlitzer_1676843053614/work
xarray @ file:///croot/xarray_1689041471350/work
xformers==0.0.28.post3
xgrammar==0.1.10
xlrd==2.0.1
XlsxWriter==3.1.9
xxhash @ file:///work/ci_py311/python-xxhash_1676842384694/work
xyzservices @ file:///work/ci_py311/xyzservices_1676828923127/work
y-py @ file:///croot/y-py_1683555143488/work
yapf @ file:///tmp/build/80754af9/yapf_1615749224965/work
yarl==1.18.3
youtube-transcript-api==0.6.3
ypy-websocket @ file:///croot/ypy-websocket_1684171737040/work
zict @ file:///croot/zict_1682698729376/work
zipp==3.21.0
zope.interface==6.0
zstandard @ file:///work/ci_py311_2/zstandard_1679339489613/work

abhinavaggarwal1981 avatar Mar 04 '25 07:03 abhinavaggarwal1981

Hmm, are you sure you are in your conda environment that's fully clean? Ex. you need to install conda and setup a clean environment for olmocr.

jakep-allenai avatar Mar 05 '25 19:03 jakep-allenai

uhmm, same with you, so frustrated

xue-affinity-123 avatar Mar 15 '25 03:03 xue-affinity-123

Have you tried again wtih pip install -e .[gpu] --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/ ??

jakep-allenai avatar Mar 17 '25 15:03 jakep-allenai

Same here, install on linux seems not working.

(venv) root@Ubuntu-2204-jammy-amd64-base ~/olmocr/olmocr/olmocr # pip install -e .[gpu] --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
pip install -e .[gpu] --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
Looking in links: https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
Obtaining file:///root/olmocr/olmocr/olmocr
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Collecting bleach
  Using cached bleach-6.2.0-py3-none-any.whl (163 kB)
Collecting ftfy
  Using cached ftfy-6.3.1-py3-none-any.whl (44 kB)
Collecting transformers==4.46.2
  Using cached transformers-4.46.2-py3-none-any.whl (10.0 MB)
Collecting torch>=2.5.1
  Using cached torch-2.7.0-cp310-cp310-manylinux_2_28_x86_64.whl (865.2 MB)
Collecting requests
  Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Collecting pypdfium2
  Using cached pypdfium2-4.30.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.9 MB)
Collecting Pillow
  Using cached pillow-11.2.1-cp310-cp310-manylinux_2_28_x86_64.whl (4.6 MB)
Collecting cached-path
  Using cached cached_path-1.7.3-py3-none-any.whl (36 kB)
Collecting orjson
  Using cached orjson-3.10.18-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (132 kB)
Collecting beaker-py
  Using cached beaker_py-2.3.0-py3-none-any.whl (85 kB)
Collecting pypdf>=5.2.0
  Using cached pypdf-5.5.0-py3-none-any.whl (303 kB)
Collecting img2pdf
  Using cached img2pdf-0.6.1.tar.gz (106 kB)
  Preparing metadata (setup.py) ... done
Collecting smart_open
  Using cached smart_open-7.1.0-py3-none-any.whl (61 kB)
Collecting zstandard
  Using cached zstandard-0.23.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB)
Collecting markdown2
  Using cached markdown2-2.5.3-py3-none-any.whl (48 kB)
Collecting lingua-language-detector
  Using cached lingua_language_detector-2.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (96.2 MB)
Collecting httpx
  Using cached httpx-0.28.1-py3-none-any.whl (73 kB)
Collecting boto3
  Using cached boto3-1.38.18-py3-none-any.whl (139 kB)
Collecting filelock
  Using cached filelock-3.18.0-py3-none-any.whl (16 kB)
Collecting cryptography
  Using cached cryptography-45.0.2-cp37-abi3-manylinux_2_34_x86_64.whl (4.5 MB)
Collecting sgl-kernel==0.0.3.post1
  Using cached sgl_kernel-0.0.3.post1-cp39-abi3-manylinux2014_x86_64.whl (9.1 MB)
Collecting sglang[all]==0.4.2
  Using cached sglang-0.4.2-py3-none-any.whl (750 kB)
Collecting IPython
  Using cached ipython-8.36.0-py3-none-any.whl (831 kB)
Collecting setproctitle
  Using cached setproctitle-1.3.6-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30 kB)
Collecting tqdm
  Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)
Collecting numpy
  Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting pyyaml>=5.1
  Using cached PyYAML-6.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (751 kB)
Collecting huggingface-hub<1.0,>=0.23.2
  Using cached huggingface_hub-0.31.2-py3-none-any.whl (484 kB)
Collecting safetensors>=0.4.1
  Using cached safetensors-0.5.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (471 kB)
Collecting tokenizers<0.21,>=0.20
  Using cached tokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting regex!=2019.12.17
  Using cached regex-2024.11.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (781 kB)
Collecting packaging>=20.0
  Using cached packaging-25.0-py3-none-any.whl (66 kB)
Collecting typing_extensions>=4.0
  Using cached typing_extensions-4.13.2-py3-none-any.whl (45 kB)
Collecting nvidia-cufile-cu12==1.11.1.6
  Using cached nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.1 MB)
Collecting triton==3.3.0
  Using cached triton-3.3.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (156.4 MB)
Collecting jinja2
  Using cached jinja2-3.1.6-py3-none-any.whl (134 kB)
Collecting nvidia-nccl-cu12==2.26.2
  Using cached nvidia_nccl_cu12-2.26.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (201.3 MB)
Collecting nvidia-curand-cu12==10.3.7.77
  Using cached nvidia_curand_cu12-10.3.7.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (56.3 MB)
Collecting nvidia-cusolver-cu12==11.7.1.2
  Using cached nvidia_cusolver_cu12-11.7.1.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (158.2 MB)
Collecting networkx
  Using cached networkx-3.4.2-py3-none-any.whl (1.7 MB)
Collecting nvidia-cufft-cu12==11.3.0.4
  Using cached nvidia_cufft_cu12-11.3.0.4-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (200.2 MB)
Collecting nvidia-nvtx-cu12==12.6.77
  Using cached nvidia_nvtx_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89 kB)
Collecting nvidia-cuda-runtime-cu12==12.6.77
  Using cached nvidia_cuda_runtime_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (897 kB)
Collecting nvidia-cusparse-cu12==12.5.4.2
  Using cached nvidia_cusparse_cu12-12.5.4.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (216.6 MB)
Collecting sympy>=1.13.3
  Using cached sympy-1.14.0-py3-none-any.whl (6.3 MB)
Collecting fsspec
  Using cached fsspec-2025.3.2-py3-none-any.whl (194 kB)
Collecting nvidia-cuda-nvrtc-cu12==12.6.77
  Using cached nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (23.7 MB)
Collecting nvidia-cuda-cupti-cu12==12.6.80
  Using cached nvidia_cuda_cupti_cu12-12.6.80-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (8.9 MB)
Collecting nvidia-cudnn-cu12==9.5.1.17
  Using cached nvidia_cudnn_cu12-9.5.1.17-py3-none-manylinux_2_28_x86_64.whl (571.0 MB)
Collecting nvidia-cublas-cu12==12.6.4.1
  Using cached nvidia_cublas_cu12-12.6.4.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (393.1 MB)
Collecting nvidia-cusparselt-cu12==0.6.3
  Using cached nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl (156.8 MB)
Collecting nvidia-nvjitlink-cu12==12.6.85
  Using cached nvidia_nvjitlink_cu12-12.6.85-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (19.7 MB)
Requirement already satisfied: setuptools>=40.8.0 in /root/olmocr/olmocr/venv/lib/python3.10/site-packages (from triton==3.3.0->torch>=2.5.1->olmocr==0.1.68) (59.6.0)
Collecting grpcio>=1.70.0
  Using cached grpcio-1.71.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.9 MB)
Collecting protobuf<6.0,>=5.0
  Using cached protobuf-5.29.4-cp38-abi3-manylinux2014_x86_64.whl (319 kB)
Collecting google-crc32c
  Using cached google_crc32c-1.7.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38 kB)
Collecting webencodings
  Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Collecting botocore<1.39.0,>=1.38.18
  Using cached botocore-1.38.18-py3-none-any.whl (13.6 MB)
Collecting s3transfer<0.13.0,>=0.12.0
  Using cached s3transfer-0.12.0-py3-none-any.whl (84 kB)
Collecting jmespath<2.0.0,>=0.7.1
  Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting google-cloud-storage<3.0,>=1.32.0
  Using cached google_cloud_storage-2.19.0-py2.py3-none-any.whl (131 kB)
Collecting rich<14.0,>=12.1
  Using cached rich-13.9.4-py3-none-any.whl (242 kB)
Collecting cffi>=1.14
  Using cached cffi-1.17.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (446 kB)
Collecting wcwidth
  Using cached wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Collecting anyio
  Using cached anyio-4.9.0-py3-none-any.whl (100 kB)
Collecting idna
  Using cached idna-3.10-py3-none-any.whl (70 kB)
Collecting certifi
  Using cached certifi-2025.4.26-py3-none-any.whl (159 kB)
Collecting httpcore==1.*
  Using cached httpcore-1.0.9-py3-none-any.whl (78 kB)
Collecting h11>=0.16
  Using cached h11-0.16.0-py3-none-any.whl (37 kB)
Collecting pikepdf
  Using cached pikepdf-9.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB)
INFO: pip is looking at multiple versions of markdown2 to determine which version is compatible with other requirements. This could take a while.
Collecting markdown2
  Using cached markdown2-2.5.2-py3-none-any.whl (48 kB)
  Using cached markdown2-2.5.1-py2.py3-none-any.whl (48 kB)
  Using cached markdown2-2.5.0-py2.py3-none-any.whl (47 kB)
  Using cached markdown2-2.4.13-py2.py3-none-any.whl (41 kB)
  Using cached markdown2-2.4.12-py2.py3-none-any.whl (41 kB)
  Using cached markdown2-2.4.11-py2.py3-none-any.whl (41 kB)
  Using cached markdown2-2.4.10-py2.py3-none-any.whl (39 kB)
INFO: pip is looking at multiple versions of markdown2 to determine which version is compatible with other requirements. This could take a while.
  Using cached markdown2-2.4.9-py2.py3-none-any.whl (39 kB)
  Using cached markdown2-2.4.8-py2.py3-none-any.whl (38 kB)
  Using cached markdown2-2.4.7-py2.py3-none-any.whl (38 kB)
  Using cached markdown2-2.4.6-py2.py3-none-any.whl (37 kB)
  Using cached markdown2-2.4.5-py2.py3-none-any.whl (36 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached markdown2-2.4.4-py2.py3-none-any.whl (36 kB)
  Using cached markdown2-2.4.3-py2.py3-none-any.whl (35 kB)
  Using cached markdown2-2.4.2-py2.py3-none-any.whl (34 kB)
  Using cached markdown2-2.4.1-py2.py3-none-any.whl (34 kB)
  Using cached markdown2-2.4.0-py2.py3-none-any.whl (34 kB)
  Using cached markdown2-2.3.10-py2.py3-none-any.whl (34 kB)
  Using cached markdown2-2.3.9-py2.py3-none-any.whl (34 kB)
INFO: pip is looking at multiple versions of lingua-language-detector to determine which version is compatible with other requirements. This could take a while.
Collecting lingua-language-detector
  Using cached lingua_language_detector-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (74.7 MB)
  Using cached lingua_language_detector-1.4.1-py3-none-any.whl (93.4 MB)
Collecting brotli<2.0.0,>=1.1.0
  Using cached Brotli-1.1.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (3.0 MB)
Collecting lingua-language-detector
  Using cached lingua_language_detector-1.4.0-py3-none-any.whl (93.4 MB)
  Using cached lingua_language_detector-1.3.5-py3-none-any.whl (71.6 MB)
Collecting regex!=2019.12.17
  Using cached regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB)
Collecting lingua-language-detector
  Using cached lingua_language_detector-1.3.4-py3-none-any.whl (86.7 MB)
Collecting numpy
  Using cached numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
Collecting lingua-language-detector
  Using cached lingua_language_detector-1.3.3-py3-none-any.whl (86.7 MB)
Collecting numpy
  Using cached numpy-1.24.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
Collecting lingua-language-detector
  Using cached lingua_language_detector-1.3.2-py3-none-any.whl (86.7 MB)
Collecting regex!=2019.12.17
  Using cached regex-2022.10.31-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (770 kB)
INFO: pip is looking at multiple versions of lingua-language-detector to determine which version is compatible with other requirements. This could take a while.
Collecting lingua-language-detector
  Using cached lingua_language_detector-1.3.1-py3-none-any.whl (86.7 MB)
  Using cached lingua_language_detector-1.3.0-py3-none-any.whl (86.7 MB)
  Using cached lingua_language_detector-1.2.1-py3-none-any.whl (86.7 MB)
  Using cached lingua_language_detector-1.2.0-py3-none-any.whl (86.7 MB)
  Using cached lingua_language_detector-1.1.3-py3-none-any.whl (86.7 MB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached lingua_language_detector-1.1.2-py3-none-any.whl (86.7 MB)
  Using cached lingua_language_detector-1.1.1-py3-none-any.whl (80.4 MB)
  Using cached lingua_language_detector-1.1.0-py3-none-any.whl (80.4 MB)
  Using cached lingua_language_detector-1.0.1-py3-none-any.whl (86.6 MB)
  Using cached lingua_language_detector-1.0.0-py3-none-any.whl (86.6 MB)
Collecting regex!=2019.12.17
  Using cached regex-2021.11.10-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (764 kB)
INFO: pip is looking at multiple versions of img2pdf to determine which version is compatible with other requirements. This could take a while.
Collecting img2pdf
  Using cached img2pdf-0.6.0.tar.gz (106 kB)
  Preparing metadata (setup.py) ... done
INFO: pip is looking at multiple versions of httpcore to determine which version is compatible with other requirements. This could take a while.
Collecting httpcore==1.*
  Using cached httpcore-1.0.8-py3-none-any.whl (78 kB)
Collecting h11<0.15,>=0.13
  Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Collecting httpcore==1.*
  Using cached httpcore-1.0.7-py3-none-any.whl (78 kB)
  Using cached httpcore-1.0.6-py3-none-any.whl (78 kB)
  Using cached httpcore-1.0.5-py3-none-any.whl (77 kB)
  Using cached httpcore-1.0.4-py3-none-any.whl (77 kB)
  Using cached httpcore-1.0.3-py3-none-any.whl (77 kB)
  Using cached httpcore-1.0.2-py3-none-any.whl (76 kB)
INFO: pip is looking at multiple versions of httpcore to determine which version is compatible with other requirements. This could take a while.
  Using cached httpcore-1.0.1-py3-none-any.whl (76 kB)
  Using cached httpcore-1.0.0-py3-none-any.whl (76 kB)
INFO: pip is looking at multiple versions of httpx to determine which version is compatible with other requirements. This could take a while.
Collecting httpx
  Using cached httpx-0.28.0-py3-none-any.whl (73 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached httpx-0.27.2-py3-none-any.whl (76 kB)
Collecting sniffio
  Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting httpx
  Using cached httpx-0.27.1-py3-none-any.whl (76 kB)
  Using cached httpx-0.27.0-py3-none-any.whl (75 kB)
  Using cached httpx-0.26.0-py3-none-any.whl (75 kB)
  Using cached httpx-0.25.2-py3-none-any.whl (74 kB)
  Using cached httpx-0.25.1-py3-none-any.whl (75 kB)
INFO: pip is looking at multiple versions of httpx to determine which version is compatible with other requirements. This could take a while.
  Using cached httpx-0.25.0-py3-none-any.whl (75 kB)
Collecting httpcore<0.19.0,>=0.18.0
  Using cached httpcore-0.18.0-py3-none-any.whl (76 kB)
Collecting httpx
  Using cached httpx-0.24.1-py3-none-any.whl (75 kB)
Collecting httpcore<0.18.0,>=0.15.0
  Using cached httpcore-0.17.3-py3-none-any.whl (74 kB)
Collecting httpx
  Using cached httpx-0.24.0-py3-none-any.whl (75 kB)
  Using cached httpx-0.23.3-py3-none-any.whl (71 kB)
Collecting httpcore<0.17.0,>=0.15.0
  Using cached httpcore-0.16.3-py3-none-any.whl (69 kB)
Collecting rfc3986[idna2008]<2,>=1.3
  Using cached rfc3986-1.5.0-py2.py3-none-any.whl (31 kB)
Collecting httpx
  Using cached httpx-0.23.2-py3-none-any.whl (86 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached httpx-0.23.1-py3-none-any.whl (84 kB)
  Using cached httpx-0.23.0-py3-none-any.whl (84 kB)
Collecting httpcore<0.16.0,>=0.15.0
  Using cached httpcore-0.15.0-py3-none-any.whl (68 kB)
Collecting httpx
  Using cached httpx-0.22.0-py3-none-any.whl (84 kB)
Collecting charset-normalizer
  Using cached charset_normalizer-3.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (149 kB)
Collecting httpcore<0.15.0,>=0.14.5
  Using cached httpcore-0.14.7-py3-none-any.whl (68 kB)
Collecting httpx
  Using cached httpx-0.21.3-py3-none-any.whl (83 kB)
  Using cached httpx-0.21.2-py3-none-any.whl (83 kB)
  Using cached httpx-0.21.1-py3-none-any.whl (83 kB)
  Using cached httpx-0.21.0-py3-none-any.whl (83 kB)
  Using cached httpx-0.20.0-py3-none-any.whl (82 kB)
Collecting httpcore<0.14.0,>=0.13.3
  Using cached httpcore-0.13.7-py3-none-any.whl (58 kB)
Collecting httpx
  Using cached httpx-0.19.0-py3-none-any.whl (77 kB)
  Using cached httpx-0.18.2-py3-none-any.whl (76 kB)
  Using cached httpx-0.18.1-py3-none-any.whl (75 kB)
  Using cached httpx-0.18.0-py3-none-any.whl (75 kB)
  Using cached httpx-0.17.1-py3-none-any.whl (68 kB)
Collecting httpcore<0.13,>=0.12.1
  Using cached httpcore-0.12.3-py3-none-any.whl (55 kB)
Collecting httpx
  Using cached httpx-0.17.0-py3-none-any.whl (68 kB)
INFO: pip is looking at multiple versions of h11 to determine which version is compatible with other requirements. This could take a while.
Collecting h11==0.*
  Using cached h11-0.15.0-py3-none-any.whl (37 kB)
  Using cached h11-0.13.0-py3-none-any.whl (58 kB)
  Using cached h11-0.12.0-py3-none-any.whl (54 kB)
  Using cached h11-0.11.0-py2.py3-none-any.whl (54 kB)
  Using cached h11-0.10.0-py2.py3-none-any.whl (53 kB)
  Using cached h11-0.9.0-py2.py3-none-any.whl (53 kB)
INFO: pip is looking at multiple versions of h11 to determine which version is compatible with other requirements. This could take a while.
  Using cached h11-0.8.1-py2.py3-none-any.whl (55 kB)
  Using cached h11-0.8.0-py2.py3-none-any.whl (55 kB)
  Using cached h11-0.7.0-py2.py3-none-any.whl (53 kB)
  Using cached h11-0.6.0-py2.py3-none-any.whl (52 kB)
  Using cached h11-0.5.0-py2.py3-none-any.whl (50 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
INFO: pip is looking at multiple versions of sniffio to determine which version is compatible with other requirements. This could take a while.
Collecting sniffio
  Using cached sniffio-1.3.0-py3-none-any.whl (10 kB)
  Using cached sniffio-1.2.0-py3-none-any.whl (10 kB)
  Using cached sniffio-1.1.0-py3-none-any.whl (4.5 kB)
  Using cached sniffio-1.0.0-py3-none-any.whl (4.4 kB)
Collecting httpcore==0.12.*
  Using cached httpcore-0.12.2-py3-none-any.whl (54 kB)
INFO: pip is looking at multiple versions of sniffio to determine which version is compatible with other requirements. This could take a while.
  Using cached httpcore-0.12.1-py3-none-any.whl (54 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached httpcore-0.12.0-py3-none-any.whl (53 kB)
Collecting httpx
  Using cached httpx-0.16.1-py3-none-any.whl (65 kB)
   Using cached httpx-0.16.0-py3-none-any.whl (65 kB)
  Using cached httpx-0.15.5-py3-none-any.whl (65 kB)
Collecting httpcore==0.11.*
  Using cached httpcore-0.11.1-py3-none-any.whl (52 kB)
  Using cached httpcore-0.11.0-py3-none-any.whl (52 kB)
Collecting httpx
  Using cached httpx-0.15.4-py3-none-any.whl (65 kB)
  Using cached httpx-0.15.3-py3-none-any.whl (64 kB)
  Using cached httpx-0.15.2-py3-none-any.whl (64 kB)
  Using cached httpx-0.15.1-py3-none-any.whl (64 kB)
  Using cached httpx-0.15.0-py3-none-any.whl (64 kB)
  Using cached httpx-0.14.3-py3-none-any.whl (62 kB)
Collecting chardet==3.*
  Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting httpcore==0.10.*
  Using cached httpcore-0.10.2-py3-none-any.whl (48 kB)
INFO: pip is looking at multiple versions of chardet to determine which version is compatible with other requirements. This could take a while.
Collecting chardet==3.*
  Using cached chardet-3.0.3-py2.py3-none-any.whl (133 kB)
  Using cached chardet-3.0.2-py2.py3-none-any.whl (133 kB)
  Using cached chardet-3.0.1-py2.py3-none-any.whl (133 kB)
  Using cached chardet-3.0.0-py2.py3-none-any.whl (133 kB)
INFO: pip is looking at multiple versions of chardet to determine which version is compatible with other requirements. This could take a while.
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Collecting httpcore==0.10.*
  Using cached httpcore-0.10.1-py3-none-any.whl (47 kB)
  Using cached httpcore-0.10.0-py3-none-any.whl (47 kB)
Collecting httpx
  Using cached httpx-0.14.2-py3-none-any.whl (61 kB)
  Using cached httpx-0.14.1-py3-none-any.whl (60 kB)
Collecting idna==2.*
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
INFO: pip is looking at multiple versions of idna to determine which version is compatible with other requirements. This could take a while.
  Using cached idna-2.9-py2.py3-none-any.whl (58 kB)
  Using cached idna-2.8-py2.py3-none-any.whl (58 kB)
  Using cached idna-2.7-py2.py3-none-any.whl (58 kB)
  Using cached idna-2.6-py2.py3-none-any.whl (56 kB)
  Using cached idna-2.5-py2.py3-none-any.whl (55 kB)
  Using cached idna-2.4-py2.py3-none-any.whl (55 kB)
  Using cached idna-2.3-py2.py3-none-any.whl (55 kB)
INFO: pip is looking at multiple versions of idna to determine which version is compatible with other requirements. This could take a while.
  Using cached idna-2.2-py2.py3-none-any.whl (55 kB)
  Using cached idna-2.1-py2.py3-none-any.whl (54 kB)
  Using cached idna-2.0-py2.py3-none-any.whl (61 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Collecting httpx
  Using cached httpx-0.14.0-py3-none-any.whl (59 kB)
  Using cached httpx-0.13.3-py3-none-any.whl (55 kB)
Collecting httpcore==0.9.*
  Using cached httpcore-0.9.1-py3-none-any.whl (42 kB)
Collecting hstspreload
  Using cached hstspreload-2025.1.1-py3-none-any.whl (1.3 MB)
Collecting h2==3.*
  Using cached h2-3.2.0-py2.py3-none-any.whl (65 kB)
Collecting hyperframe<6,>=5.2.0
  Using cached hyperframe-5.2.0-py2.py3-none-any.whl (12 kB)
Collecting hpack<4,>=3.0
  Using cached hpack-3.0.0-py2.py3-none-any.whl (38 kB)
INFO: pip is looking at multiple versions of h2 to determine which version is compatible with other requirements. This could take a while.
Collecting h2==3.*
  Using cached h2-3.1.1-py2.py3-none-any.whl (64 kB)
  Using cached h2-3.1.0-py2.py3-none-any.whl (64 kB)
  Using cached h2-3.0.1-py2.py3-none-any.whl (71 kB)
  Using cached h2-3.0.0-py2.py3-none-any.whl (70 kB)
Collecting hpack<3,>=2.3
  Using cached hpack-2.3.0-py2.py3-none-any.whl (36 kB)
INFO: pip is looking at multiple versions of h2 to determine which version is compatible with other requirements. This could take a while.
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.

Constey avatar May 18 '25 07:05 Constey

Are you sure that you are using a clean python 3.11 environment when installing?

jakep-allenai avatar May 20 '25 19:05 jakep-allenai

It was really a python version issue. ubuntu has 3.10.x per default via apt. had to manually upgrade to python 3.11, so everything is working now.

Constey avatar May 20 '25 20:05 Constey

Ya, it's gotta be 3.11 or higher!

jakep-allenai avatar May 20 '25 20:05 jakep-allenai