zksync-era
zksync-era copied to clipboard
Published
20 hours ago •
matter-labs
matter-labs
error(prover_fri): Error occurred while processing FriCpuProver job: "index out of bounds: the len is 55967519 but the index is 55977310"
🐛 Bug Report
📝 Description
When trying to generate fri proof, meets error Error occurred while processing FriCpuProver job 44: "index out of bounds: the len is 55967519 but the index is 56017283" (detail in the logs)
🔄 Reproduction Steps
- Start service Follow https://github.com/matter-labs/zksync-era/blob/9b701e70a4046cf9a84ce264d71e4ae0e8835f88/prover/prover_fri/README.md to run the whole node and
# 1. start db,l1
zk init
# 2. start sequencer
zk server --components=api,eth,tree,state_keeper,housekeeper,proof_data_handler
# ready to start prover
cd prover
# 3. start gateway
zk f cargo run --release --bin zksync_prover_fri_gateway
# 4. start witness
API_PROMETHEUS_LISTENER_PORT=3116 zk f cargo run --release --bin zksync_witness_generator -- --all_rounds
# 5. start aggregate prover
zk f cargo run --release --bin zksync_prover_fri
# 6. start fri prover
zk f cargo run --release --bin zksync_proof_fri_compressor
- transfer from l1->l2 to generate new l2's block
# 1. login geth and fund it
docker container exec -it zksync-era-geth-1 geth attach http://localhost:8545
eth.sendTransaction({from: personal.listAccounts[0], to: "0x618263CE921F7dd5F4f40C29f6c524Aaf97b9bbd", value: "7400000000000000000"})
# 2. bridge geth from l1->
# Key in: Private key of the sender: 0x5090c024edb3bdf4ce2ebc2da96bedee925d9d77d729687e5e2d56382cf0a5a6 Recipient address on L2: 0x618263CE921F7dd5F4f40C29f6c524Aaf97b9bbd
npx zksync-cli bridge deposit
🤔 Expected Behavior
Everything works fine.
😯 Current Behavior
As logs shows.
🖥️ Environment
- Ubuntu 22.04
- repo commit:
b4663c362204f76039457e06803a9f42b25c0090(The latest one. date:20240218)
📋 Additional Context
📎 Log Output
2024-02-18T08:56:02.497185Z ERROR zksync_queued_job_processor: Error occurred while processing FriCpuProver job 28: "index out of bounds: the len is 55967519 but the index is 56007627"
2024-02-18T08:56:02.505812Z INFO zksync_prover_fri_utils: Started processing prover job: FriProverJobMetadata { id: 27, block_number: L1BatchNumber(1), circuit_id: 1, aggregation_round: BasicCircuits, sequence_number: 26, depth: 0, is_node_final_proof: false }
thread 'thread 'thread 'thread 'thread '<unnamed><unnamed><unnamed><unnamed><unnamed>' panicked at ' panicked at ' panicked at ' panicked at ' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs:::::373373373373373:::::5151515151:
:
:
:
:
index out of bounds: the len is 55967519 but the index is 56007627index out of bounds: the len is 55967519 but the index is 55987306index out of bounds: the len is 55967519 but the index is 56027270index out of bounds: the len is 55967519 but the index is 55967575index out of bounds: the len is 55967519 but the index is 55970864
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::thread 'thread 'panickingthread '<unnamed><unnamed>::<unnamed>' panicked at ' panicked at panic_fmt' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs::/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs::hb85e049a4301ecd3:373373
373:: :5151 51:
:
:
index out of bounds: the len is 55967519 but the index is 55969970index out of bounds: the len is 55967519 but the index is 55967539 index out of bounds: the len is 55967519 but the index is 55977557
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
thread ' <unnamed> ' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs : 373 : at 51/rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:
:index out of bounds: the len is 55967519 but the index is 5596757344
:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
thread 'thread 'thread ' thread '<unnamed>thread 'thread '<unnamed><unnamed> <unnamed>' panicked at <unnamed><unnamed>' panicked at ' panicked at ' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs' panicked at ' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs:/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs/mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs:: :373::373373 373:373373:: :51::5151 51:
5151:
:
:
index out of bounds: the len is 55967519 but the index is 55997541:
:
index out of bounds: the len is 55967519 but the index is 56017525index out of bounds: the len is 55967519 but the index is 56057493 index out of bounds: the len is 55967519 but the index is 56037509
index out of bounds: the len is 55967519 but the index is 55977310index out of bounds: the len is 55967519 but the index is 56017283
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
thread ' <unnamed> ' panicked at /mnt/rust/git/checkouts/era-boojum-eee09114f0ca3855/03888f0/src/cs/implementations/witness.rs at :/rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs373::16251::
5index out of bounds: the len is 55967519 but the index is 55969968
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
stack backtrace:
0: 0x55ad9c54129c - std::backtrace_rs::backtrace::libunwind::trace::h68b3f03db065435f
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
1: 0x55ad9c54129c - std::backtrace_rs::backtrace::trace_unsynchronized::hcc29d957a519c467
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55ad9c54129c - std::sys_common::backtrace::_print_fmt::h51e5567c7446b80e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:67:5
3: 0x55ad9c54129c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h54890bb4d0b3c330
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55ad9c56ea7c - core::fmt::rt::Argument::fmt::heae7cd8ccc900aeb
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/rt.rs:138:9
5: 0x55ad9c56ea7c - core::fmt::write::hc761729f1163b685
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/fmt/mod.rs:1094:21
6: 0x55ad9c53d77e - std::io::Write::write_fmt::hd8de790e313b58ee
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/io/mod.rs:1714:15
7: 0x55ad9c541084 - std::sys_common::backtrace::_print::h1b2adaff5c947b3b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55ad9c541084 - std::sys_common::backtrace::print::hf6a9b81f93e62890
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55ad9c542eba - std::panicking::panic_hook_with_disk_dump::{{closure}}::h663629ab1a73f13e
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:278:22
10: 0x55ad9c542ba7 - std::panicking::panic_hook_with_disk_dump::h7dc7628c0cba33b1
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:312:9
11: 0x55ad9c5434bb - std::panicking::default_hook::h4cb3ec769d1db09c
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:239:5
12: 0x55ad9c5434bb - std::panicking::rust_panic_with_hook::hdd1521f6ef2543b7
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:729:13
13: 0x55ad9c5433b7 - std::panicking::begin_panic_handler::{{closure}}::h7c4ede115dee30b0
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:621:13
14: 0x55ad9c5417c6 - std::sys_common::backtrace::__rust_end_short_backtrace::habd7cadfbd319a50
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys_common/backtrace.rs:170:18
15: 0x55ad9c543102 - rust_begin_unwind
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/panicking.rs:617:5
16: 0x55ad9b555903 - core::panicking::panic_fmt::hb85e049a4301ecd3
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:67:14
17: 0x55ad9b555a59 - core::panicking::panic_bounds_check::h7b704d1c15838175
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/core/src/panicking.rs:162:5
18: 0x55ad9babf3c4 - <rayon_core::job::HeapJob<BODY> as rayon_core::job::Job>::execute::hd61092bbe34735bb
19: 0x55ad9b517eef - rayon_core::registry::WorkerThread::wait_until_cold::ha2c081ae56b84d14
20: 0x55ad9bd14722 - rayon_core::registry::ThreadBuilder::run::hde83f1acf0479363
21: 0x55ad9bd17eca - std::sys_common::backtrace::__rust_begin_short_backtrace::hdbbb6fdd911fe468
22: 0x55ad9bd1956f - core::ops::function::FnOnce::call_once{{vtable.shim}}::hbe536001651f24c9
23: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7bbddabb40181918
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
24: 0x55ad9c546245 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4e41f7977be0d993
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/alloc/src/boxed.rs:2007:9
25: 0x55ad9c546245 - std::sys::unix::thread::Thread::new::thread_start::h6eb72cf9b874b24b
at /rustc/5c6a7e71cd66705c31c9af94077901a220f0870c/library/std/src/sys/unix/thread.rs:108:17
26: 0x7f3104294ac3 - <unknown>
27: 0x7f3104326850 - <unknown>
28: 0x0 - <unknown>
2024-02-18T08:56:37.559071Z ERROR zksync_queued_job_processor: Error occurred while processing FriCpuProver job 27: "index out of bounds: the len is 55967519 but the index is 56007627"
2024-02-18T08:56:37.562546Z INFO zksync_prover_fri_utils: Started processing prover job: FriProverJobMetadata { id: 28, block_number: L1BatchNumber(1), circuit_id: 1, aggregation_round: BasicCircuits, sequence_number: 27, depth: 0, is_node_final_proof: false }
- Error Code https://github.com/matter-labs/era-boojum/blob/3acdbf5386d43691a83e9166a0d72ba10fb95c0e/src/cs/implementations/witness.rs#L361-L382
// we copy column-wise (each worker to it's independent set of columns)
worker.scope(result.len(), |scope, chunk_size| {
for (vars_chunk, polys_chunk) in hint
.maps
.chunks(chunk_size)
.zip(result.chunks_mut(chunk_size))
{
scope.spawn(move |_| {
debug_assert_eq!(vars_chunk.len(), polys_chunk.len());
for (vars_column, poly) in vars_chunk.iter().zip(polys_chunk.iter_mut()) {
for (var, dst) in vars_column.iter().zip(poly.storage.iter_mut()) {
if var.is_placeholder() == false {
*dst = witness_ref[var.0 as usize]; // Error happens here
} else {
// we can use 0 as a substitue for all undefined variables,
// or add ZK into them
}
}
}
});
}
});
Hi, @EmilLuta As https://github.com/matter-labs/zksync-era/issues/1008#issuecomment-1926335423:
I believe it's very likely that this error is related to wrong inputs for the proof. Whilst I don't have enough context around what happened (looks like part of the cryptography code), can you share what input was used to generate this proof? Also, maybe your env vars for running them, etc.
Would you like to detail it? As many tables in database are expty, like witness_inputs_fri, prover_jobs_fri, scheduler_witness_jobs_fri, proof_compression_jobs_fri,
Sure thing. I reckon your setup is wrong. In order to pick up a proof, you MUST have entries in witness_inputs_fri and prover_jobs_fri at least. I'd suggest a reset. Additionally, could you make sure you're checking the right tables (have to be in prover database, not zksync*)?
I'd suggest checking the latest version and follow up with a zk && zk clean --all && zk init. Afterwards, you can follow the aforementioned steps.
P.S. I'm not sure witness_generator step works as intended, but we can troubleshoot it once we get there.
@EmilLuta Thx for pointing the the right databse to query the prover-releated table datas. The latest code meet same error(I've update the error logs)
According to the error logs, I query and list the related table:
- miniblocks
number | l1_batch_number | timestamp | hash | l1_tx_count | l2_tx_count | base_fee_per_gas | gas_per_pubdata_limit | created_at | updated_at | l1_gas_price | l2_fair_gas_price | bootloader_code_hash | default_aa_code_hash | protocol_version | virtual_blocks | fee_account_address | fair_pubdata_price | consensus
--------+-----------------+------------+--------------------------------------------------------------------+-------------+-------------+------------------+-----------------------+----------------------------+----------------------------+--------------+-------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+------------------+----------------+--------------------------------------------+--------------------+-----------
1 | 1 | 1708233841 | \x3e369a1c50564207961f1ff54401ebc12517d0fb6ac5ef56517a0e039769e24d | 10 | 0 | 100000000 | 32000 | 2024-02-18 05:24:02.374062 | 2024-02-18 05:24:02.374062 | 800000008 | 100000000 | \x010007ed0e328b940e241f7666a6303b7ffd4e3fd7e8c154d6e7556befe6cd6d | \x0100055b7a8be90522251be8be1a186464d056462973502ac8a0437c85e4d2a9 | 20 | 1 | \xde03a0b5963f75f1c8485b355ff6d30f3093bde7 | 13600000136 |
- witness_inputs_fri
l1_batch_number | merkle_tree_paths_blob_url | attempts | status | error | created_at | updated_at | processing_started_at | time_taken | is_blob_cleaned | protocol_version | picked_by
-----------------+----------------------------+----------+------------+-------+----------------------------+----------------------------+----------------------------+------------+-----------------+------------------+-------------
1 | merkel_tree_paths_1.bin | 1 | successful | | 2024-02-18 05:33:07.685159 | 2024-02-18 06:28:20.316876 | 2024-02-18 06:28:08.208645 | 00:00:12 | | 2 | UNKNOWN_POD
(1 row)
- prover_jobs_fri
id | l1_batch_number | circuit_id | circuit_blob_url | aggregation_round | sequence_number | status | error | attempts | processing_started_at | created_at | updated_at | time_taken | is_blob_cleaned | depth | is_node_final_proof | proof_blob_url | protocol_version | picked_by
----+-----------------+------------+----------------------------+-------------------+-----------------+--------+--------------------------------------------------------------------+----------+----------------------------+---------------------------+----------------------------+------------+-----------------+-------+---------------------+----------------+------------------+-------------
28 | 1 | 1 | 1_27_1_BasicCircuits_0.bin | 0 | 27 | failed | index out of bounds: the len is 55967519 but the index is 56027270 | 10 | 2024-02-18 09:01:18.696745 | 2024-02-18 06:28:20.25078 | 2024-02-18 09:01:53.555417 | | | 0 | f | | 2 | UNKNOWN_POD
The id started from 1, and the
1_27_1_BasicCircuits_0.binstarted from 0.
- The data are as follows: tmp-zksync-data.zip
Is this a GPU or a CPU prover? Are you running the stack locally or remotely on a GPU + CUDA capable machine?
Is this a GPU or a CPU prover? Are you running the stack locally or remotely on a GPU + CUDA capable machine?
Hi, @EmilLuta , It's the CPU prover. Thanks for your help. I've figured out the reason behind this bug, as below:
Background
-
To run prover, need executing
./setup.shto generate setup datas first, which caused a lot time. (nearly 2 hours) In order to quickly develop, I've reused the generated setup-datas (before 2024.1.1). -
The setup-data will be used to synthesize the constraint system.
Singularity
#791 has updated the finalization_hints and verification_basic_x_key in setup data.
Solution
Re-generate the setup data by the latest finalization_hints and verification_basic_x_key.
Yeah, that seems about right. I was expecting something in the setup was broken. I can understand why caching the keys was tempting. Good luck with developing!