Replibyte icon indicating copy to clipboard operation
Replibyte copied to clipboard

Working with AWS RDS MySQL

Open rgarrigue opened this issue 1 year ago • 6 comments

Hi there

We're having issue with RDS MySQL, being unable to get replibyte to dump so far. Tried as much permission as we could, on a read replica, nothing did it. Any hints ?

Thanks

rgarrigue avatar Sep 12 '23 09:09 rgarrigue

Hello,

The issue we've (I'm a colleague of @rgarrigue) been having is this

replibyte --config conf.yaml dump create
⠐ [00:00:00] [------------------------------------------------------------------------------------------------------------------------------] 0B/100.00MiB (0s)
command error: mysqldump: [Warning] Using a password on the command line interface can be insecure.
mysqldump: Couldn't execute 'FLUSH TABLES WITH READ LOCK': Access denied for user 'foo'@'%' (using password: YES) (1045)
⠙ [00:00:00] [>--------------------------------------------------------------------------------------------------------------------------] 827B/100.00MiB (17h)

I have been able to find some information about the issue and workarounds. One is to downgrade the mysqldump version and another is to add --set-gtid-purged=OFF to the connection string. I've tested adding the latter one to replibyte locally and it's running just fine when added.

I'm not sure how this would translate to amending this in replibyte but a potential solution would perhaps to add optional database options?

emilsivervik avatar Sep 12 '23 14:09 emilsivervik

Hi @emilsivervik and @rgarrigue - indeed, a potential solution would be to add the ability to add extra options. I'm first working on dump and restore performance issues and I'll work on adding this.

evoxmusic avatar Sep 13 '23 08:09 evoxmusic

@emilsivervik how do you add --set-gtid-purged=OFF to replibyte ?

billmetangmo avatar Oct 11 '23 09:10 billmetangmo

Sorry @billmetangmo I totally missed that you wrote to me. What we did was to fork the repository and add the options to the dump command.

emilsivervik avatar Mar 15 '24 07:03 emilsivervik

Cool @emilsivervik . Is your fork available publicly ?

billmetangmo avatar Mar 15 '24 10:03 billmetangmo

@billmetangmo We added some internal build stuff also so no it's private.

I did a fork to my account which you can check you if you want to, it's the same changes as we added to our company one.

https://github.com/emilsivervik/replibyte

emilsivervik avatar Mar 15 '24 18:03 emilsivervik