dbx
dbx copied to clipboard
dbx sync will not handle files larger than 1mb
Expected Behavior
dbx sync should sync all files regardless of length.
Current Behavior
When a file to be sync'd is larger than the 1MB limit allowed for by the put command, the sync fails.
Steps to Reproduce (for bugs)
Create a file larger than 1MB and include it in a sync.
Context
We use ANTLR generated python files for parsing, which produce large source files (approximately 4MB). Trying to sync a repo that includes these files fails with the current release.
Your Environment
- dbx version used: 0.5.0
- Databricks Runtime version: 10.5 and 11.2