dbx icon indicating copy to clipboard operation
dbx copied to clipboard

dbx repo sync fails with new files created

Open farridav opened this issue 1 year ago • 8 comments

Expected Behavior

When a new file is added, it should synchronise it with databricks

Current Behavior

When a new file is added, the sync repo watcher exits with ClientError: 400

Steps to Reproduce (for bugs)

  • setup a repo in databricks
  • have the same repo locally
  • configure/authenticate dbx
  • run dbx sync repo --dest-repo <repo_name> --source ./ from within the local repo
  • run touch newfile.py

Context

This seems to be a bit intermittent, as after writing this bug report, i cannot get it to fail, though my colleague can

Logs

[dbx][2022-11-25 17:24:39.165] Syncing from /home/my_user/workspace/my_repo
[dbx][2022-11-25 17:24:39.175] Ignoring patterns from /home/my_user/workspace/my_repo/.gitignore
[dbx][2022-11-25 17:24:39.181] Target base path: /Repos/my_user/my_repo
[dbx][2022-11-25 17:24:39.184] Starting initial copy
[dbx][2022-11-25 17:24:39.185] Restoring sync snapshot from /home/my_user/workspace/my_repo/.dbx/sync/my_repo-repos-352542dab58972f5ceede78b86bfa4fc
[dbx][2022-11-25 17:24:39.191] Checking if any unmatched files/directories would be deleted
[dbx][2022-11-25 17:24:39.193] Deleting /Repos/my_user/my_repo/notebooks/test2.ipynb
[dbx][2022-11-25 17:24:39.693] Putting /Repos/my_user/my_repo/promo_forecasting/data_load.py
[dbx][2022-11-25 17:24:39.701] Putting /Repos/my_user/my_repo/promo_forecasting/main.py
[dbx][2022-11-25 17:24:39.708] Putting /Repos/my_user/my_repo/notebooks/development.ipynb
[dbx][2022-11-25 17:24:40.505] Done. Watching for changes...
[dbx][2022-11-25 17:25:01.809] Putting /Repos/my_user/my_repo/notebooks/testing.ipynb
[dbx][2022-11-25 17:25:02.366] HTTP 400: {"message":"Request failed for POST notebooks/testing.ipynb"}

Your Environment

  • dbx version used: 0.8.7
  • Databricks Runtime version: 11.3

farridav avatar Nov 25 '22 17:11 farridav