The local windows installer script doesn't work
Describe the bug
When running in the powershell .\start_gpu.ps1, the environnement gets installer properly (at the line uv pip install -e ".[gpu]"). However, the next line uv run --no-sync python docker/scripts/download_model.py --output api/src/models/v1_0 produces the following error:
Traceback (most recent call last):
File "D:\ia\Kokoro-FastAPI\docker\scripts\download_model.py", line 9, in <module>
from loguru import logger
ModuleNotFoundError: No module named 'loguru'
I checked with pip list and loguru 0.7.3 is installed.
Then, during the next line uv run --no-sync uvicorn api.src.main:app --host 0.0.0.0 --port 8880, it raises the following error. Maybe the powershell forgets about the environment variable that were defined previously?
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "C:\Users\Armaguedin\miniconda3\Scripts\uvicorn.exe\__main__.py", line 10, in <module>
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1442, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1363, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1226, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 794, in invoke
return callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\main.py", line 412, in main
run(
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\main.py", line 579, in run
server.run()
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 66, in run
return asyncio.run(self.serve(sockets=sockets))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\runners.py", line 194, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\base_events.py", line 687, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 70, in serve
await self._serve(sockets)
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 77, in _serve
config.load()
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\config.py", line 435, in load
self.loaded_app = import_from_string(self.app)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\importer.py", line 22, in import_from_string
raise exc from None
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\importer.py", line 19, in import_from_string
module = importlib.import_module(module_str)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Armaguedin\miniconda3\Lib\importlib\__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 995, in exec_module
File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
File "D:\ia\Kokoro-FastAPI\api\src\main.py", line 18, in <module>
from .routers.development import router as dev_router
File "D:\ia\Kokoro-FastAPI\api\src\routers\development.py", line 12, in <module>
from kokoro import KPipeline
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\__init__.py", line 22, in <module>
from .model import KModel
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\model.py", line 2, in <module>
from .modules import CustomAlbert, ProsodyPredictor, TextEncoder
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\modules.py", line 4, in <module>
from transformers import AlbertModel
File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\transformers\utils\import_utils.py", line 2048, in __getattr__
raise ModuleNotFoundError(
ModuleNotFoundError: Could not import module 'AlbertModel'. Are this object's requirements defined correctly?
Branch / Deployment used It's the master branch, commit 6b1e9d9 (the latest commit)
Operating System I have a 5090 card, pytorch with cuda 12.8, python 3.12.7, windows 10 pro, no docker.
@EugeoSynthesisThirtyTwo this should be fixed in the install-script-fixes branch:
git clone https://github.com/remsky/Kokoro-FastAPI.git --branch install-script-fixes
Can you please test it and tell me if it works for you?