maigret icon indicating copy to clipboard operation
maigret copied to clipboard

various issues

Open PsyChip opened this issue 10 months ago • 0 comments

  1. database is obsolete: i examined the url list, there is more than 1700~ site entries but only around 500 of them is active (got screenshots)
  2. false positives: some websites redirecting to main page when there is no username, maigret assuming it's a profile page
  3. consider puppeteer: most websites using client side rendering now, showing empty content to command line scrapers.
  4. consider 2b llm agents: it's almost impossible to maintain repository to align with 500~ websites, create a pipeline to a low latency agent to verify profile exists or not

PsyChip avatar Feb 18 '25 03:02 PsyChip