bug: relocate jan data folder didn't work

[FaintShadow]

Problem I always hate it when programs don't allow you to change the installation location of their apps (on windows at least)

Success Criteria I want to be able to change the installation directory and also the directory where the extensions are installed/downloaded. as for the installation location it could be either in the installer if not maybe you could provide a portable version (zip, rar, etc...) where the app just uses relative paths

Additional context Not everyone has enough space on their main C drive, so its better to install things on other drives they have

[Van-QA]

Thank you for highlighting this, we will consider your request. cc: @imtuyethan

On the other hand, atm there is a temporary workaround solution where you can install (as usual) and move the Jan app to any location afterward. I hope this can help resolve your issue in the mean time.

[FaintShadow]

Thank you for highlighting this, we will consider your request. cc: @imtuyethan

On the other hand, atm there is a temporary workaround solution where you can install (as usual) and move the Jan app to any location afterward. I hope this can help resolve your issue in the mean time.

The program didn't even open, my disk is full. so it just installed and Its stuck on "preparing updates" and I thought the problem is my disk space...

[dwiehoff]

On the other hand, atm there is a temporary workaround solution where you can install (as usual) and move the Jan app to any location afterward. I hope this can help resolve your issue in the mean time.

I moved the folder to an external hard drive. It loads the model and shows it as active, yet I can't type in the chatbot, which remains inactive.

https://github.com/janhq/jan/assets/20980287/a71692a1-661d-4484-b444-849661fb054a

[imtuyethan]

@FaintShadow As @Van-QA mentioned, we have the option to allow users to change app directory. So sorry that is it not obvious, we're working on adding this to onboarding steps.

It seems like @FaintShadow & @dwiehoff had some bugs with this feature, can you help me take a look? @Van-QA. In the meantime, i will change this ticket to bug ticket. Thanks everyone!

[Van-QA]

hi @FaintShadow, @dwiehoff can you try again on latest build? We made a few changes recently regarding the Jan data folder: https://github.com/janhq/jan/issues/2326 Please let us know if the issue persists 🙏

[louis-jan]

@FaintShadow @dwiehoff please feel free to reopen if it still occurs.

[FaintShadow]

hi @FaintShadow, @dwiehoff can you try again on latest build? We made a few changes recently regarding the Jan data folder: #2326 Please let us know if the issue persists 🙏

Hey there, I installed the latest Build as of the Time I am posting this, then I installed "Stable Zephyr 3B Q8" on the same directory (I didn't change it for now) and Its not working It says "failed to start"

[Van-QA]

hi @FaintShadow, can you give us your app.log?

[FaintShadow]

hi @FaintShadow, can you give us your app.log?

This is the app.log:

2024-04-22T06:50:57.657Z [NITRO]::Error: .
2024-04-22T06:50:57.668Z [NITRO]::Error: .
2024-04-22T06:50:57.679Z [NITRO]::Error: .
2024-04-22T06:50:57.696Z [NITRO]::Error: .
2024-04-22T06:50:57.706Z [NITRO]::Error: .
2024-04-22T06:50:57.730Z [NITRO]::Error: .
2024-04-22T06:50:57.735Z [NITRO]::Error: .
2024-04-22T06:50:57.752Z [NITRO]::Error: .
2024-04-22T06:50:57.774Z [NITRO]::Error: .
2024-04-22T06:50:57.792Z [NITRO]::Error: .
2024-04-22T06:50:57.814Z [NITRO]::Error: .
2024-04-22T06:50:57.834Z [NITRO]::Error: .
2024-04-22T06:50:57.849Z [NITRO]::Error: .
2024-04-22T06:50:57.870Z [NITRO]::Error: .
2024-04-22T06:50:57.880Z [NITRO]::Error: .
2024-04-22T06:50:57.897Z [NITRO]::Error: .
2024-04-22T06:50:57.917Z [NITRO]::Error: .
2024-04-22T06:50:57.937Z [NITRO]::Error: .
2024-04-22T06:50:57.947Z [NITRO]::Error: .
2024-04-22T06:50:57.960Z [NITRO]::Error: .
2024-04-22T06:50:57.982Z [NITRO]::Error: .
2024-04-22T06:50:57.991Z [NITRO]::Error: .
2024-04-22T06:50:58.016Z [NITRO]::Error: .
2024-04-22T06:50:58.025Z [NITRO]::Error: .
2024-04-22T06:50:58.042Z [NITRO]::Error: .
2024-04-22T06:50:58.063Z [NITRO]::Error: .
2024-04-22T06:50:58.074Z [NITRO]::Error: .

2024-04-22T06:50:58.080Z [NITRO]::Error: llama_new_context_with_model: n_ctx      = 4096
llama_new_context_with_model: freq_base  = 10000.0
llama_new_context_with_model: freq_scale = 1

2024-04-22T06:50:58.332Z [NITRO]::Error: llama_kv_cache_init:      CUDA0 KV buffer size =  1280.00 MiB
llama_new_context_with_model: KV self size  = 1280.00 MiB, K (f16):  640.00 MiB, V (f16):  640.00 MiB

2024-04-22T06:50:58.345Z [NITRO]::Error: llama_new_context_with_model:  CUDA_Host input buffer size   =    14.04 MiB

2024-04-22T06:50:58.362Z [NITRO]::Error: llama_new_context_with_model:      CUDA0 compute buffer size =   284.02 MiB
llama_new_context_with_model:  CUDA_Host compute buffer size =     5.00 MiB
llama_new_context_with_model: graph splits (measure): 3

2024-04-22T06:50:58.441Z [NITRO]::Error: CUDA error: no kernel image is available for execution on the device
  current device: 0, in function ggml_cuda_op_flatten at C:\actions-runner\_work\nitro\nitro\llama.cpp\ggml-cuda.cu:9382
  cudaGetLastError()
GGML_ASSERT: C:\actions-runner\_work\nitro\nitro\llama.cpp\ggml-cuda.cu:242: !"CUDA error"

2024-04-22T06:51:05.202Z [NITRO]::Debug: Nitro exited with code: 3221226505
2024-04-22T06:51:05.557Z [NITRO]::Error: TypeError: fetch failed
2024-04-22T06:51:05.556Z [NITRO]::Error: Load model failed with error TypeError: fetch failed

When moving Jan's data directory to a new one, It didn't remove the old one and it also didn't move the Models. I had to do that manually

[Van-QA]

hi @FaintShadow,

• The CUDA error issue is similar to this: https://github.com/janhq/jan/issues/2707. Please follow up over there.
• As for the Move Jan data folder issue related to Model folder, can you check if the model is stuck with a running process in the background?
• Sorry for the inconvenience, Jan will not remove the old Jan data folder upon relocation 🙏

[FaintShadow]

hi @FaintShadow,

• The CUDA error issue is similar to this: [WIN11] bug: CUDA unknown error when loading a model #2707. Please follow up over there.
• As for the Move Jan data folder issue related to Model folder, can you check if the model is stuck with a running process in the background?
• Sorry for the inconvenience, Jan will not remove the old Jan data folder upon relocation 🙏

I already moved it manually... but It didn't move the first time and I am not sure why. I suggested in this issue that the data directory should be specified in the installation process for Windows at least.

[Van-QA]

thank @FaintShadow, we will apply that in this task https://github.com/janhq/jan/issues/2023, stay tuned🙏 Please follow up with the CUDA issue in the #2707 :pray: