db icon indicating copy to clipboard operation
db copied to clipboard

Performance concerns

Open mcandre opened this issue 6 years ago • 0 comments

Issue description

I see MySQL clients experiencing MySQL server disconnects every few days, coinciding with an daily INSERT load of ~100K records, ~100 bytes per record, occurring over the span of 30 seconds.

Are there any C dependencies or other sources of potential out of memory issues for upper.io?

Could upper.io provide benchmarks to show solid transaction execution at 1MTPS?

Error log

2019/08/26 16:06:59 engine.go:128: Caching 34000 charges
2019/08/26 16:06:59 engine.go:128: Caching 35000 charges
2019/08/26 16:06:59 engine.go:128: Caching 36000 charges
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: read tcp <redacted>: read: connection reset by peer
2019/08/26 16:07:00 engine.go:391: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF
2019/08/26 16:07:00 engine.go:254: invalid connection
[mysql] 2019/08/26 16:07:00 packets.go:36: unexpected EOF

Configuration

Upper version (or git SHA):

commit 2f58dea678dbdcd3710158e8572025ef4d2c6df7

Go version: run go version in your console

go version go1.11.12

Server version: E.g. MySQL 5.6, MariaDB 10.0.20

MySQL 5.7, XtraDB

Server OS: E.g. Debian 8.1 (Jessie), Windows 10

RHEL 7

Potentially related to https://github.com/go-sql-driver/mysql/issues/990

mcandre avatar Aug 26 '19 20:08 mcandre