anything-llm [BUG]: Data Conector -- Github repo, maybe failed

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

it creates new folder, but it is empty. There is no file in the new folder, i have tried lots of repos.

Are there known steps to reproduce?

No response

Feb 06 '25 13:02 bnufw

Are you using a PAT? This is usually the issue for most people - they get limited by Github. Can you share a repo (public) that you are collecting so we can reproduce the issue?

Feb 06 '25 16:02 timothycarambat

Yes, i use PAT. And i can upload successfully, but there is no file in the new folder. Here is the github repo: https://github.com/jingyaogong/minimind-v

Feb 07 '25 00:02 bnufw

I also encountered the same problem (the difference is that GitHub can only retrieve 3-4 files), but after copying the project to GitLab, it worked fine.

Feb 07 '25 03:02 sunday866

@sunday866 git clone the repo, and pull it to the GitLab?

Feb 07 '25 04:02 bnufw

@bnufw I am using the built-in project import function of GitLab, which supports importing projects from GitHub

Feb 07 '25 05:02 sunday866

I am unable to replicate this. I am able to pull in both the top-level (with no PAT set) and the entire directory with nested files (using PAT).

In order to debug further we will need logs from the collector process via Docker logs or Desktop storage/logs

Feb 14 '25 20:02 timothycarambat