squiggle icon indicating copy to clipboard operation
squiggle copied to clipboard

Import historic data for Manifold

Open berekuk opened this issue 9 months ago • 0 comments

Because of various issues, right now Metaforecast misses ~13k markets for Manifold in 2024-07..2024-10 range.

Also, I think some markets for this range exist only in "extended" tables (ManifoldMarket tables), not in questions, because the importing script has failed before it got to inserting the questions into the primary questions table.

So, there are a few things to do:

  • run cli manifold fetch-new with correct beforeId and lastUpdatedTime once in production
  • find and fix the prisma bug that causes that script to fail (with a very confusing exception)
  • write a new sub-command for manifold, cli manifold markets-to-questions (?), that re-populates questions table based on existing markets data, and run it in production

berekuk avatar Mar 07 '25 16:03 berekuk