pc-part-dataset icon indicating copy to clipboard operation
pc-part-dataset copied to clipboard

Published 20 hours ago • verified publisher icon docyx

Will be any online api available?

Open WilczekCK opened this issue 3 years ago • 7 comments

As the topic says. I'm currently using the local JSON file, but I think it could be a really good api if it will be updated and available for public.

Thanks

WilczekCK avatar Feb 10 '22 11:02 WilczekCK

I've definitely thought about it.

Since PCPartPicker is pretty much impossible to scrape now with the rate limits and Recaptcha, we should probably find another site.

Maybe scrape from each manufacturer's site for the most reliable data? I don't know.

If there's enough demand for it, I can make it in a couple weeks.

docyx avatar Feb 10 '22 15:02 docyx

Keep in touch if you need some help, surely it will be released faster :) Will it be written in NodeJS (or some related framework), I'm pretty fluent with it.

WilczekCK avatar Feb 11 '22 08:02 WilczekCK

Node. I'll get a basic prototype going and let you know when it's up on GH. Thanks

docyx avatar Feb 11 '22 16:02 docyx

Update: unfortunately I haven't had the time to get started on this. If you need something sooner than, say, within the next month or two, please let me know. Otherwise it'll get done... at some point.

Sorry!

docyx avatar Apr 02 '22 13:04 docyx

No problem, I'm using the JSON file right now, so its not necessary, but would be helpful 😁

WilczekCK avatar Apr 04 '22 07:04 WilczekCK

Sadly, it's against PCPartPicker's TOS (in the Access section).

WalterClementsJr avatar Jun 21 '22 14:06 WalterClementsJr

Can you upload in jsonl format?

PierrunoYT avatar Nov 07 '23 11:11 PierrunoYT

@PierrunoYT just uploaded https://github.com/docyx/pc-part-dataset/tree/main/data

docyx avatar Nov 16 '23 18:11 docyx

No plans for an API. Closing.

docyx avatar Nov 26 '23 18:11 docyx