Consider using API

[impredicative]

https://paperswithcode.com/api/internal/papers/

[yitao-yu]

I actually checked that but I think they don't provide api for things they use for ranking(for example for trending they use #stars/hr).

Here's an another version(v1) of the api enabling you to query by a descending order of published date, but you'll have to filter out null values. I tried "arxiv_id=____._____", didn't work. JFYI.

https://paperswithcode.com/api/v1/papers/?ordering=-published

doc