oso
oso copied to clipboard
Create `readme` crawler
- fetch repos from oso graphql API
- use rest factory to grab root level
readme.mdfiles (via resource relatiosnhip) - config to provide
minTrustRankmaxTrustRank
Query;
SELECT DISTINCT url FROM int_ddp_repo_discovery_v0
WHERE trust_rank BETWEEN 1 and 100
We didn't manage to get it in time. Not urgent anymore, deprioritizing.