Kokoro-FastAPI icon indicating copy to clipboard operation
Kokoro-FastAPI copied to clipboard

The local windows installer script doesn't work

Open EugeoSynthesisThirtyTwo opened this issue 6 months ago • 1 comments

Describe the bug When running in the powershell .\start_gpu.ps1, the environnement gets installer properly (at the line uv pip install -e ".[gpu]"). However, the next line uv run --no-sync python docker/scripts/download_model.py --output api/src/models/v1_0 produces the following error:

Traceback (most recent call last):
  File "D:\ia\Kokoro-FastAPI\docker\scripts\download_model.py", line 9, in <module>
    from loguru import logger
ModuleNotFoundError: No module named 'loguru'

I checked with pip list and loguru 0.7.3 is installed.

Then, during the next line uv run --no-sync uvicorn api.src.main:app --host 0.0.0.0 --port 8880, it raises the following error. Maybe the powershell forgets about the environment variable that were defined previously?

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\Armaguedin\miniconda3\Scripts\uvicorn.exe\__main__.py", line 10, in <module>
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1442, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1363, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 1226, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\click\core.py", line 794, in invoke
    return callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\main.py", line 412, in main
    run(
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\main.py", line 579, in run
    server.run()
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\asyncio\base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 70, in serve
    await self._serve(sockets)
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\server.py", line 77, in _serve
    config.load()
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\config.py", line 435, in load
    self.loaded_app = import_from_string(self.app)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\importer.py", line 22, in import_from_string
    raise exc from None
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\uvicorn\importer.py", line 19, in import_from_string
    module = importlib.import_module(module_str)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Armaguedin\miniconda3\Lib\importlib\__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "D:\ia\Kokoro-FastAPI\api\src\main.py", line 18, in <module>
    from .routers.development import router as dev_router
  File "D:\ia\Kokoro-FastAPI\api\src\routers\development.py", line 12, in <module>
    from kokoro import KPipeline
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\__init__.py", line 22, in <module>
    from .model import KModel
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\model.py", line 2, in <module>
    from .modules import CustomAlbert, ProsodyPredictor, TextEncoder
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\kokoro\modules.py", line 4, in <module>
    from transformers import AlbertModel
  File "C:\Users\Armaguedin\miniconda3\Lib\site-packages\transformers\utils\import_utils.py", line 2048, in __getattr__
    raise ModuleNotFoundError(
ModuleNotFoundError: Could not import module 'AlbertModel'. Are this object's requirements defined correctly?

Branch / Deployment used It's the master branch, commit 6b1e9d9 (the latest commit)

Operating System I have a 5090 card, pytorch with cuda 12.8, python 3.12.7, windows 10 pro, no docker.

EugeoSynthesisThirtyTwo avatar Jun 20 '25 20:06 EugeoSynthesisThirtyTwo

@EugeoSynthesisThirtyTwo this should be fixed in the install-script-fixes branch:

git clone https://github.com/remsky/Kokoro-FastAPI.git --branch install-script-fixes

Can you please test it and tell me if it works for you?

fireblade2534 avatar Jun 20 '25 22:06 fireblade2534