lucene icon indicating copy to clipboard operation
lucene copied to clipboard

TestIndexFileDeleter.testExcInDecRef test failure [LUCENE-9839]

Open asfimport opened this issue 4 years ago • 8 comments

It isn't reproducible for me (at least trying again a single time). I'm guessing a concurrency issue?

> Task :lucene:core:test

org.apache.lucene.index.TestIndexFileDeleter > testExcInDecRef FAILED
    org.apache.lucene.store.AlreadyClosedException: ReaderPool is already closed
        at __randomizedtesting.SeedInfo.seed([9142DCE874F11926:78DFABDA0238FEDB]:0)
        at org.apache.lucene.index.ReaderPool.get(ReaderPool.java:400)
        at org.apache.lucene.index.IndexWriter.writeReaderPool(IndexWriter.java:3760)
        at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:590)
        at org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:474)
        at org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:406)
        at org.apache.lucene.index.TestIndexFileDeleter.testExcInDecRef(TestIndexFileDeleter.java:484)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:832)

org.apache.lucene.index.TestIndexFileDeleter > test suite's output saved to /home/rmuir/workspace/lucene/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.index.TestIndexFileDeleter.txt, copied below:
   >     org.apache.lucene.store.AlreadyClosedException: ReaderPool is already closed
   >         at __randomizedtesting.SeedInfo.seed([9142DCE874F11926:78DFABDA0238FEDB]:0)
   >         at org.apache.lucene.index.ReaderPool.get(ReaderPool.java:400)
   >         at org.apache.lucene.index.IndexWriter.writeReaderPool(IndexWriter.java:3760)
   >         at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:590)
   >         at org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:474)
   >         at org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:406)
   >         at org.apache.lucene.index.TestIndexFileDeleter.testExcInDecRef(TestIndexFileDeleter.java:484)
   >         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   >         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
   >         at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   >         at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
   >         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44)
   >         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
   >         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
   >         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
   >         at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   >         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
   >         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
   >         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
   >         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
   >         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
   >         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   >         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   >         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:51)
   >         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
   >         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
   >         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
   >         at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   >         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
   >         at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
   >         at java.base/java.lang.Thread.run(Thread.java:832)
  2> NOTE: reproduce with: gradlew test --tests TestIndexFileDeleter.testExcInDecRef -Dtests.seed=9142DCE874F11926 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=yue-Hans -Dtests.timezone=America/Eirunepe -Dtests.asserts=true -Dtests.file.encoding=UTF-8
  2> NOTE: leaving temporary files on disk at: /tmp/lucene_gradle/lucene.index.TestIndexFileDeleter_9142DCE874F11926-001
  2> NOTE: test params are: codec=Asserting(Lucene90): {field=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=Direct), content=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, maxPointsInLeafNode=629, maxMBSortInHeap=5.627723832659357, sim=Asserting(RandomSimilarity(queryNorm=false): {field=DFR I(ne)BZ(0.3), content=IB SPL-LZ(0.3)}), locale=yue-Hans, timezone=America/Eirunepe
  2> NOTE: Linux 5.11.6-arch1-1 amd64/N/A 15.0.2 (64-bit)/cpus=1,threads=1,free=369546928,total=534773760
  2> NOTE: All tests run in this JVM: [TestComplexExplanationsOfNonMatches, TestRegexpRandom2, TestPhraseQuery, TestFieldMaskingSpanQuery, TestSpanNotQuery, TestSpanMultiTermQueryWrapper, TestSpanTermQuery, TestScorerPerf, TestLatLonPointQueries, TestDateSort, TestMatchAllDocsQuery, TestShardSearching, TestIndriAndQuery, TestBooleanOr, TestBooleanQueryVisitSubscorers, TestSynonymQuery, TestPrefixRandom, TestIntRangeFieldQueries, TestTopDocsMerge, TestSimpleExplanationsWithFillerDocs, TestLongValuesSource, TestWANDScorer, TestQueryVisitor, TestSloppyPhraseQuery, TestNeedsScores, TestSearchWithThreads, TestMinShouldMatch2, TestComplexExplanations, TestMaxClauseLimit, TestFieldCacheRewriteMethod, TestMultiTermConstantScore, TestPositiveScoresOnlyCollector, TestTermQuery, TestLMJelinekMercerSimilarity, TestBooleanSimilarity, TestLMDirichletSimilarity, TestAxiomaticF3EXP, TestBasicModelIF, TestIndriDirichletSimilarity, TestBooleanMinShouldMatch, TestSortedSetSortField, TestBoolean2, TestTopFieldCollectorEarlyTermination, TestSloppyMath, TestDirectPacked, TestDaciukMihovAutomatonBuilder, TestAutomaton, TestCompiledAutomaton, TestPagedBytes, TestFrequencyTrackingRingBuffer, TestFSTs, TestWeakIdentityMap, TestAttributeSource, TestDocIdsWriter, Test2BBKDPoints, TestCloseableThreadLocal, TestIOUtils, TestSparseFixedBitDocIdSet, TestMergedIterator, TestRecyclingByteBlockAllocator, TestNotDocIdSet, TestCharsRefBuilder, TestBytesRef, TestQueryBuilder, TestHighLZ4, TestFixedLengthBytesRefArray, TestBytesRefHash, TestCachingTokenFilter, TestCharacterUtils, TestCharTermAttributeImpl, TestAnalyzerWrapper, TestGraphTokenFilter, TestSearchForDuplicates, TestGeoUtils, TestLine2D, TestXYPolygon, TestXYCircle, TestByteBuffersDirectory, TestBufferedChecksum, TestTrackingDirectoryWrapper, TestRateLimiter, TestChecksumIndexInput, TestMmapDirectory, TestLongRange, TestFeatureSort, TestLatLonPointDistanceFeatureQuery, TestLatLonShape, TestXYPointShapeQueries, TestXYPolygonShapeQueries, TestLatLonLineShapeQueries, TestFieldType, TestDateTools, TestSegmentReader, TestIndexWriterDelete, TestParallelLeafReader, TestReaderWrapperDVTypeCheck, TestBagOfPostings, TestBagOfPositions, TestDocumentsWriterPerThreadPool, Test2BDocs, TestIndexWriterThreadsToSegments, TestPrefixCodedTerms, TestPersistentSnapshotDeletionPolicy, TestIndexFileDeleter]

Migrated from LUCENE-9839 by Robert Muir (@rmuir), updated Nov 05 2021 Attachments: image-2021-11-05-09-35-38-980.png

asfimport avatar Mar 15 '21 01:03 asfimport

Patrick Zhai (@zhaih) (migrated from JIRA)

This same error appeared in my PR's auto check as well: https://github.com/apache/lucene/runs/3873024350?check_suite_focus=true

And went away after retry...

asfimport avatar Oct 14 '21 00:10 asfimport

Dawid Weiss (@dweiss) (migrated from JIRA)

image-2021-11-05-09-35-38-980.png

Happened on Github CI again.

asfimport avatar Nov 05 '21 08:11 asfimport

This random failure is still happening in recent CI builds (e.g. here), but never seems to repro for me.

I'll try to add some "verbosity on failure" to the test.

mikemccand avatar Nov 15 '22 13:11 mikemccand

I'm wondering if, in CI with multiplier, this test hits something like file handle limit (too many open files) or similar, and masks the exc somehow?

rmuir avatar Nov 15 '22 13:11 rmuir

I just popped this when pushing an unrelated commit. I see @mikemccand added more verbosity, but then reverted the verbosity (maybe because it caused the test to never fail anymore?)

link: https://github.com/apache/lucene/actions/runs/8554729592/job/23440647130

output:

org.apache.lucene.index.TestIndexFileDeleter > test suite's output saved to /home/runner/work/lucene/lucene/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.index.TestIndexFileDeleter.txt, copied below:
   >     org.apache.lucene.store.AlreadyClosedException: ReaderPool is already closed
   >         at __randomizedtesting.SeedInfo.seed([F5635EBE50E38053:1CFE298C262A67AE]:0)
   >         at app//org.apache.lucene.index.ReaderPool.get(ReaderPool.java:397)
   >         at app//org.apache.lucene.index.IndexWriter.writeReaderPool(IndexWriter.java:3998)
   >         at app//org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:597)
   >         at app//org.apache.lucene.index.IndexWriter$4.getReader(IndexWriter.java:6620)
   >         at app//org.apache.lucene.tests.index.RandomIndexWriter.getReader(RandomIndexWriter.java:495)
   >         at app//org.apache.lucene.tests.index.RandomIndexWriter.getReader(RandomIndexWriter.java:427)
   >         at app//org.apache.lucene.index.TestIndexFileDeleter.testExcInDecRef(TestIndexFileDeleter.java:481)
   >         at [email protected]/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
   >         at [email protected]/java.lang.reflect.Method.invoke(Method.java:580)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
   >         at app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
   >         at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
   >         at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
   >         at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
   >         at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
   >         at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:[390](https://github.com/apache/lucene/actions/runs/8554729592/job/23440647130#step:4:391))
   >         at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
   >         at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
   >         at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
   >         at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
   >         at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   >         at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   >         at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   >         at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
   >         at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
   >         at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
   >         at app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
   >         at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
   >         at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   >         at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
   >         at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
   >         at [email protected]/java.lang.Thread.run(Thread.java:1583)
  2> NOTE: reproduce with: gradlew test --tests TestIndexFileDeleter.testExcInDecRef -Dtests.seed=F5635EBE50E38053 -Dtests.locale=en-TT -Dtests.timezone=Greenwich -Dtests.asserts=true -Dtests.file.encoding=UTF-8
  2> NOTE: leaving temporary files on disk at: /home/runner/work/lucene/lucene/lucene/core/build/tmp/tests-tmp/lucene.index.TestIndexFileDeleter_F5635EBE50E38053-001
  2> NOTE: test params are: codec=Asserting(Lucene99): {field=FST50, id=PostingsFormat(name=LuceneVarGapFixedInterval), content=Lucene99}, docValues:{}, maxPointsInLeafNode=77, maxMBSortInHeap=6.580453733478[409](https://github.com/apache/lucene/actions/runs/8554729592/job/23440647130#step:4:410), sim=Asserting(RandomSimilarity(queryNorm=false): {field=DFR I(F)B2, content=ClassicSimilarity}), locale=en-TT, timezone=Greenwich
  2> NOTE: Linux 6.5.0-1016-azure amd64/Eclipse Adoptium 21.0.2 (64-bit)/cpus=4,threads=1,free=195783776,total=279969792
  2> NOTE: All tests run in this JVM: [TestAssertions, TestExternalCodecs, TestSearch, TestAbstractAnalysisFactory, TestAnalyzerWrapper, TestCachingTokenFilter, TestCharArraySet, TestCharacterUtils, TestGraphTokenFilter, TestReusableStringReader, TestWordlistLoader, TestStandardFactories, TestCharTermAttributeImpl, TestSimpleAttributeImpl, TestCodecUtil, TestMinimalCodec, TestFastCompressionMode, TestHighCompressionMode, TestIndexedDISI, TestLucene90DocValuesFormat, TestLucene90FieldInfosFormat, TestLucene90NormsFormat, TestLucene90PointsFormat, TestLucene90StoredFieldsFormatHighCompression, TestLucene90TermVectorsFormat, TestCompressingStoredFieldsFormat, TestStoredFieldsInt, TestForDeltaUtil, TestLucene99HnswQuantizedVectorsFormat, TestLucene99PostingsFormat, TestPForUtil, TestPerFieldKnnVectorsFormat, TestPerFieldPostingsFormat2, TestDateTools, TestDoubleRange, TestFeatureField, TestField, TestFloatRange, TestIntRange, TestLatLonDocValuesField, TestLatLonDocValuesPointPointQueries, TestLatLonLineShapeQueries, TestLatLonMultiPointPointQueries, TestLatLonMultiPolygonShapeQueries, TestLatLonPointDistanceFeatureQuery, TestLatLonPointPointQueries, TestLatLonPointShapeQueries, TestLatLonPolygonShapeQueries, TestLatLonShapeEncoding, TestLongHashSet, TestManyKnnDocs, TestShapeDocValues, TestXYLineShapeDVQueries, TestXYMultiLineShapeQueries, TestXYMultiPolygonShapeQueries, TestXYPointShapeQueries, TestXYPolygonShapeQueries, TestXYShapeEncoding, TestCircle2D, TestGeoUtils, TestPoint, TestPolygon, TestRectangle2D, TestTessellator, TestXYLine, TestXYPolygon, Test2BBinaryDocValues, Test2BNumericDocValues, Test2BPositions, Test2BPostingsBytes, Test2BSortedDocValuesOrds, Test4GBStoredFields, TestAllFilesCheckIndexHeader, TestAllFilesDetectTruncation, TestAllFilesHaveCodecHeader, TestAtomicUpdate, TestBagOfPostings, TestBinaryTerms, TestByteSlicePool, TestCachingMergeContext, TestCodecHoldsOpenFiles, TestConcurrentApproximatePriorityQueue, TestConsistentFieldNumbers, TestCrashCausesCorruptIndex, TestCustomTermFreq, TestDemoParallelLeafReader, TestDirectoryReaderReopen, TestDocCount, TestDocInverterPerFieldErrorInfo, TestDocValuesFieldUpdates, TestDocsAndPositions, TestDocumentWriter, TestDocumentsWriterPerThreadPool, TestDuelingCodecs, TestExceedMaxTermLength, TestFieldInfos, TestFieldReuse, TestFieldsReader, TestFilterDirectoryReader, TestFilterLeafReader, TestFlex, TestForTooMuchCloning, TestFrozenBufferedUpdates, TestIndexFileDeleter]

rmuir avatar Apr 04 '24 12:04 rmuir

I wonder if "concurrency issue" is jumping to conclusions. My machine has almost no concurrency: 1 cpu with 2 cores...

rmuir avatar Apr 04 '24 13:04 rmuir

It still does pop up from time to time. No idea what's happening there.

dweiss avatar Apr 05 '24 07:04 dweiss

I too have seen this time to time. It does replicate rarely on my machine if I run it many times (thousands) with stress-ng eating my CPU cores.

Do we want to add back some verbosity on failure? There is something weird going on here :/

benwtrent avatar Jun 28 '24 20:06 benwtrent