steem
steem copied to clipboard
Too many open files
When in replay with v0.22.0 and Mira On, it stops at 5%:
4.45412% 1600000 of 35921766 (125000 objects cached using 15M)
4.73251% 1700000 of 35921766 (125000 objects cached using 14M)
5.01089% 1800000 of 35921766 (125000 objects cached using 14M)
1305117ms multi_index_container.hpp:695 modify_ ] IO error: While open a file for appending: /dev/shm/rocksdb_block_summary_object/000261.sst: Too many open files
1305124ms database.cpp:3253 _apply_block ] 13 N5boost16exception_detail10clone_implINS0_19error_info_injectorISt11logic_errorEEEE: Could not modify object, most likely a uniqueness constraint was violated
Could not modify object, most likely a uniqueness constraint was violated:
{"what":"Could not modify object, most likely a uniqueness constraint was violated"}
database.cpp:3832 create_block_summary
1305124ms database.cpp:3253 _apply_block ] next_block.block_num(): 1871484
13 N5boost16exception_detail10clone_implINS0_19error_info_injectorISt11logic_errorEEEE: Could not modify object, most likely a uniqueness constraint was violated
Could not modify object, most likely a uniqueness constraint was violated:
{"what":"Could not modify object, most likely a uniqueness constraint was violated"}
database.cpp:3832 create_block_summary
rethrow
{"next_block.block_num()":1871484}
database.cpp:3253 _apply_block
{"next_block":{"previous":"001c8e7b184f9a76308c615f249fd7bc765ce323","timestamp":"2016-05-29T12:37:09","witness":"kushed","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f1d2e6d78ad9f96337c95980f096504633912e31c2f5aca47106544fed78fbc0554d0dbf4ddc6b9edae1a796873049ffcbe04281887e403c367dd0550dccb3c95","transactions":[]}}
database.cpp:3027 apply_block
{"args.data_dir":"/root/.steemd/blockchain","args.shared_mem_dir":"/dev/shm"}
database.cpp:345 reindex
what are the right parameters for open files on the system? node was running v0.20.9 without any issues so far.
EDIT: Deliverable is updating MIRA documentation on how to increase ulimit when running steem with MIRA natively in Linux, OSX, and in Docker.
https://www.tecmint.com/increase-set-open-file-limits-in-linux/
65536 is a cool number for the limit.
related issues: #2554 and #2904