oso icon indicating copy to clipboard operation
oso copied to clipboard

Create `readme` crawler

Open Jabolol opened this issue 2 months ago • 2 comments

  • fetch repos from oso graphql API
  • use rest factory to grab root level readme.md files (via resource relatiosnhip)
  • config to provide minTrustRank maxTrustRank

Query;

SELECT DISTINCT url FROM int_ddp_repo_discovery_v0
WHERE trust_rank BETWEEN 1 and 100

Jabolol avatar Nov 17 '25 20:11 Jabolol

OSO-1298

linear[bot] avatar Nov 17 '25 20:11 linear[bot]

We didn't manage to get it in time. Not urgent anymore, deprioritizing.

Jabolol avatar Nov 19 '25 15:11 Jabolol