test tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains extremely slow

[PSeitz]

        SLOW [>120.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>180.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>240.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>300.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>360.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>420.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>480.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>540.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>600.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>660.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>720.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>780.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>840.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>900.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>960.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1020.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1080.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1140.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1200.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1260.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1320.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1380.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1440.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1500.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1560.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1620.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1680.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1740.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1800.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1860.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1920.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>1980.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2040.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2100.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2160.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2220.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2280.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2340.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        SLOW [>2400.000s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains
        PASS [2451.700s] tantivy::failpoints test_fail_on_flush_segment_but_one_worker_remains

[PSeitz]

The issue appeared locally, this is a flamegraph from the process