gridfsmigrate

gridfsmigrate copied to clipboard

No files are copied if i run the dump command

8

Hello, i want to migrate the uploads from our RocketChat Installation from GridFS to FileSystem i have installed phyton3 and phyton-pip. I have also installed phyton-pip pymongo and boto3 i...

phatair

Clarifications on #5

1

Hey @arminfelder First of all, thanks for creating this script! A lifesaver for all naive-but-growing RC setups like mine In the instructions, the fifth point reads > Check if everything...

dmonn

Would it be possible to update this to support MognoDB 5.0.3? I get the following when trying to migrate: --- 2022/06/19 21:55:20 Connecting to database to detect source upload config...

fc757

Upload error to S3 (DigitalOcean Spaces)

2

Hi, after uploading 1535 files to S3 (DigitalOcean Spaces) an error occurs: ``` Traceback (most recent call last): File "/dumpfiles/gridfsmigrate/./migrate.py", line 236, in obj.dumpfiles("rocketchat_uploads", store) File "/dumpfiles/gridfsmigrate/./migrate.py", line 121, in...

Robert-turbo

gridfs.errors.CorruptGridFile: no chunk #0

3

Hello, Executing the python script like below ``` python3 ./migrate.py -c dump -r rocketchat -t FileSystem -d /root/gridfs_dump/ ``` And here is the return error. ``` Traceback (most recent call...

xxzk

Not working with non English?

4

``` Traceback (most recent call last): File "./migrate.py", line 232, in obj.dumpfiles("rocketchat_uploads", store) File "./migrate.py", line 116, in dumpfiles upload['name'])) UnicodeEncodeError: 'ascii' codec can't encode characters in position 30-33: ordinal...

ranqiangjun

We set `PYTHONIOENCODING=utf-8` as mentioned in the Readme. But when the script computes the first file with an umlaut in the filename, in our case: `14. Dumping 29sDGZSx79ozo6JWu Clipboard -...

sennewood

Is there any way to improve performance

2

I adjusted the script a little bit on my fork. Following is the pseudocode: Before: ``` for item in items: dump_file() for item in items: update_db() for item in items:...

ranqiangjun

Moving to filesystem breaks images due to extensions

7

Cool tool! I just ran it to move files out of GridFS to the local file system. Some images worked, some images didn't work... I spent about a half hour...

wreiske

migrate into an already existing s3 bucket

1

More a question than a bug. Currently we already use S3 as Uploads Backend but we have a lot of uploads in gridfs too. Is it save to migrate the...

himpierre