dbx icon indicating copy to clipboard operation
dbx copied to clipboard

dbx sync will not handle files larger than 1mb

Open greentim opened this issue 3 years ago • 0 comments

Expected Behavior

dbx sync should sync all files regardless of length.

Current Behavior

When a file to be sync'd is larger than the 1MB limit allowed for by the put command, the sync fails.

Steps to Reproduce (for bugs)

Create a file larger than 1MB and include it in a sync.

Context

We use ANTLR generated python files for parsing, which produce large source files (approximately 4MB). Trying to sync a repo that includes these files fails with the current release.

Your Environment

  • dbx version used: 0.5.0
  • Databricks Runtime version: 10.5 and 11.2

greentim avatar Oct 06 '22 16:10 greentim