dbx
dbx copied to clipboard
dbx repo sync fails with new files created
Expected Behavior
When a new file is added, it should synchronise it with databricks
Current Behavior
When a new file is added, the sync repo
watcher exits with ClientError: 400
Steps to Reproduce (for bugs)
- setup a repo in databricks
- have the same repo locally
- configure/authenticate dbx
- run
dbx sync repo --dest-repo <repo_name> --source ./
from within the local repo - run
touch newfile.py
Context
This seems to be a bit intermittent, as after writing this bug report, i cannot get it to fail, though my colleague can
Logs
[dbx][2022-11-25 17:24:39.165] Syncing from /home/my_user/workspace/my_repo
[dbx][2022-11-25 17:24:39.175] Ignoring patterns from /home/my_user/workspace/my_repo/.gitignore
[dbx][2022-11-25 17:24:39.181] Target base path: /Repos/my_user/my_repo
[dbx][2022-11-25 17:24:39.184] Starting initial copy
[dbx][2022-11-25 17:24:39.185] Restoring sync snapshot from /home/my_user/workspace/my_repo/.dbx/sync/my_repo-repos-352542dab58972f5ceede78b86bfa4fc
[dbx][2022-11-25 17:24:39.191] Checking if any unmatched files/directories would be deleted
[dbx][2022-11-25 17:24:39.193] Deleting /Repos/my_user/my_repo/notebooks/test2.ipynb
[dbx][2022-11-25 17:24:39.693] Putting /Repos/my_user/my_repo/promo_forecasting/data_load.py
[dbx][2022-11-25 17:24:39.701] Putting /Repos/my_user/my_repo/promo_forecasting/main.py
[dbx][2022-11-25 17:24:39.708] Putting /Repos/my_user/my_repo/notebooks/development.ipynb
[dbx][2022-11-25 17:24:40.505] Done. Watching for changes...
[dbx][2022-11-25 17:25:01.809] Putting /Repos/my_user/my_repo/notebooks/testing.ipynb
[dbx][2022-11-25 17:25:02.366] HTTP 400: {"message":"Request failed for POST notebooks/testing.ipynb"}
Your Environment
- dbx version used: 0.8.7
- Databricks Runtime version: 11.3