steem icon indicating copy to clipboard operation
steem copied to clipboard

Too many open files

Open isnochys opened this issue 6 years ago • 2 comments

When in replay with v0.22.0 and Mira On, it stops at 5%:

   4.45412%   1600000 of 35921766   (125000 objects cached using 15M)
   4.73251%   1700000 of 35921766   (125000 objects cached using 14M)
   5.01089%   1800000 of 35921766   (125000 objects cached using 14M)
1305117ms multi_index_container.hpp:695 modify_              ] IO error: While open a file for appending: /dev/shm/rocksdb_block_summary_object/000261.sst: Too many open files
1305124ms database.cpp:3253             _apply_block         ] 13 N5boost16exception_detail10clone_implINS0_19error_info_injectorISt11logic_errorEEEE: Could not modify object, most likely a uniqueness constraint was violated
Could not modify object, most likely a uniqueness constraint was violated:
    {"what":"Could not modify object, most likely a uniqueness constraint was violated"}
    database.cpp:3832 create_block_summary
1305124ms database.cpp:3253             _apply_block         ] next_block.block_num(): 1871484
13 N5boost16exception_detail10clone_implINS0_19error_info_injectorISt11logic_errorEEEE: Could not modify object, most likely a uniqueness constraint was violated
Could not modify object, most likely a uniqueness constraint was violated:
    {"what":"Could not modify object, most likely a uniqueness constraint was violated"}
    database.cpp:3832 create_block_summary
rethrow
    {"next_block.block_num()":1871484}
    database.cpp:3253 _apply_block

    {"next_block":{"previous":"001c8e7b184f9a76308c615f249fd7bc765ce323","timestamp":"2016-05-29T12:37:09","witness":"kushed","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f1d2e6d78ad9f96337c95980f096504633912e31c2f5aca47106544fed78fbc0554d0dbf4ddc6b9edae1a796873049ffcbe04281887e403c367dd0550dccb3c95","transactions":[]}}
    database.cpp:3027 apply_block

    {"args.data_dir":"/root/.steemd/blockchain","args.shared_mem_dir":"/dev/shm"}
    database.cpp:345 reindex

what are the right parameters for open files on the system? node was running v0.20.9 without any issues so far.

EDIT: Deliverable is updating MIRA documentation on how to increase ulimit when running steem with MIRA natively in Linux, OSX, and in Docker.

isnochys avatar Aug 31 '19 05:08 isnochys

https://www.tecmint.com/increase-set-open-file-limits-in-linux/

65536 is a cool number for the limit.

emre avatar Aug 31 '19 10:08 emre

related issues: #2554 and #2904

TimCliff avatar Aug 31 '19 14:08 TimCliff