dumpling
dumpling copied to clipboard
pingcap
Dumpling is a fast, easy-to-use tool written by Go for dumping data from the database(MySQL, TiDB...) to local/cloud(S3, GCP...) in multifarious formats(SQL, CSV...).
## Feature Request **Is your feature request related to a problem? Please describe:** When dumpling dumps with `--compress gzip` parameter, dumpling will dump several compressed files. Here is an example:...
## Feature Request **Is your feature request related to a problem? Please describe:** We use Aurora for most of our databases, and would strongly prefer avoiding using passwords for ad-hoc...
## Description ### Background Currently dumpling's performance is only 1/2 to 2/3 of mydumper. There are two parts that cost a lot of time for dumpling. 1. After analyzing the...
Now dumpling computes `estimatedChunks` through tidb `estRows`. ```go // every chunk would have eventual adjustments estimatedChunks := count / conf.Rows estimatedStep := (max-min)/estimatedChunks + 1 ``` When table is not...
SQL and CSV are not easy to parse. The purpose of Dumpling is to support a binary format which allows Lightning to read data more quickly. * [ ] Decide...
Create an MVP for this project, showing performance and correctness. See pingcap/community#123 for the full list of expectations. Checklist: * [ ] Make sure your architecture takes account of all...
## Feature Request **Is your feature request related to a problem? Please describe:** **Describe the feature you'd like:** Progress bar works properly while exporting data with non-integer primary key from...
We should be able recover the progress even if we `kill -9`ed Dumpling.
## Feature Request **Is your feature request related to a problem? Please describe:** Currently, we don't know whether dumped data is correct because we don't have a checksum mechanism now....
## Feature Request **Is your feature request related to a problem? Please describe:** Currently, dumpling error code is not collected in TiDB error code system. **Describe the feature you'd like:**...