Memory error

[tjsherlock]

I tried to run the executable on my Mac Book Pro with 317.46 GB available. Managed to get a memory error. Just speculating if this might be the result of an infinite loop. Otherwise, there was a ton of syntax errors, as if everything were just slightly off. See error log attached. mysql2sqlite_err.log

[dumblob]

There might be multiple reasons. Could you please ensure the dump you're converting was made either with mysqldump --skip-extended-insert --compact or mysqldump --no-data?

If so, could you please post output of head -n 200 dump.sql; ./mysql2sqlite dump.sql | head -n 200?

If there is some sensitive information in plain text (i.e. non-encoded & non-encrypted), just add something like | sed -E 's|[0-9a-zA-Z]|x|g' (this one doesn't account for non-ASCII characters).

---

Btw. this script works in a fully streaming fashion so it's independent from the DB size - it should use at most few MBytes (maybe few tenths of MBytes if used at POSIX limits on a modern 64bit machine). Terabytes of data should be piece of cake even on embedded devices with just few MBytes of RAM and no computational power.