db
db copied to clipboard
Performance concerns
Issue description
I see MySQL clients experiencing MySQL server disconnects every few days, coinciding with an daily INSERT load of ~100K records, ~100 bytes per record, occurring over the span of 30 seconds.
Are there any C dependencies or other sources of potential out of memory issues for upper.io?
Could upper.io provide benchmarks to show solid transaction execution at 1MTPS?
Error log
2019/08/26 16:06:59 engine.go:128: Caching 34000 charges
2019/08/26 16:06:59 engine.go:128: Caching 35000 charges
2019/08/26 16:06:59 engine.go:128: Caching 36000 charges
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
2019/08/26 16:07:00 engine.go:391: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
Configuration
Upper version (or git SHA):
commit 2f58dea678dbdcd3710158e8572025ef4d2c6df7
Go version: run go version in your console
go version go1.11.12
Server version: E.g. MySQL 5.6, MariaDB 10.0.20
MySQL 5.7, XtraDB
Server OS: E.g. Debian 8.1 (Jessie), Windows 10
RHEL 7
Potentially related to https://github.com/go-sql-driver/mysql/issues/990