quora-scraper icon indicating copy to clipboard operation
quora-scraper copied to clipboard

Quora-Scraper doesn't scrape my own profile

Open kalebtekle opened this issue 4 years ago • 5 comments

I write a scraping query on command line , quora-scraper users [kaleab woldemariam] but the scrapper doesn't scrape anything. I know my profile is there on Quora. https://www.quora.com/profile/Kaleab-Woldemariam. Is there any syntax error?

kalebtekle avatar Sep 30 '20 05:09 kalebtekle

You forget the -l argument before the list, plus the username should not contain spaces, try this: quora-scraper users -l [kaleab-woldemariam]

banyous avatar Sep 30 '20 07:09 banyous

Tried your comment, but still doesn't scrape anything.

kalebtekle avatar Sep 30 '20 09:09 kalebtekle

I started fixing the code in this repo but gave up when I realized it wouldn't be a quick fix.

You might be interested in this alternative tool that I wrote based on this repo. It automatically expands all your collapsed articles and comments. Depending on the amount of answers and comments you have, this can save you many hours of work. You can then save it as PDF for full text searches and click on the dates of the articles and comments to jump back to the original content online.

https://github.com/swiss-chris/quora-expander

swiss-chris avatar Mar 08 '21 07:03 swiss-chris

@swiss-chris Is the code in your repo still valid?! I need to scrape quora question and answers for specific topics, but neither of the two codes works for me, I also tried to write scrapper form scratch, but it didn't work :(

eng-aomar avatar Oct 24 '21 18:10 eng-aomar

@swiss-chris Is the code in your repo still valid?! I need to scrape quora question and answers for specific topics, but neither of the two codes works for me, I also tried to write scrapper form scratch, but it didn't work :(

@eng-aomar it was working a few months ago. Haven't tried it lately. However, as I recall, it only works for scraping the entire writings of a particular Quora user / profile_id. But maybe analyzing the source code you can get it to work for your purposes as well (topics). That's how I did it.

swiss-chris avatar Oct 24 '21 18:10 swiss-chris