linvo-scraper icon indicating copy to clipboard operation
linvo-scraper copied to clipboard

Scrape groups

Open nevo-david opened this issue 2 years ago • 12 comments

Add group scraping https://www.linkedin.com/groups/6519652/members/

Try to solve the infinite scroll problem

nevo-david avatar Oct 08 '22 02:10 nevo-david

Hey @nevo-david I would like to work on the issue. Although I haven't worked so much in scraping but a quick learner. If you guides a little bit then it will be easy. What's this infinite scroll problem in context of scraping groups can you explain?

Gulshanaggarwal avatar Oct 08 '22 05:10 Gulshanaggarwal

Hi @Gulshanaggarwal, Thank you so much for being a part of it!

In every Linkedin search, you have pagination (10/25 results per page). But for the group area, there is a scrolling that shows more results every time you go down.

So you would need to scroll down multiple times to get all the prospects.

Let me know how else I can help :) Do you want me to assign it to you? :)

nevo-david avatar Oct 08 '22 05:10 nevo-david

@nevo-david I just gone through Linkedin but for Group you have pagination already available there. You don't need to scroll again & again. See the image below->

Annotation 2022-10-08 152835

Is there something else I'm missing?

Gulshanaggarwal avatar Oct 08 '22 09:10 Gulshanaggarwal

Yes, this is a group search, I am talking about a specific group :) Just enter a group

nevo-david avatar Oct 08 '22 10:10 nevo-david

Hey @nevo-david but still I don't see the issue. Can you please share the screenshot?

Gulshanaggarwal avatar Oct 08 '22 10:10 Gulshanaggarwal

For example, enter here https://www.linkedin.com/groups/6519652/ Screen Shot 2022-10-08 at 17 38 18

And then https://www.linkedin.com/groups/6519652/members/

nevo-david avatar Oct 08 '22 10:10 nevo-david

I got it @nevo-david. Thanks for the screenshot, actually I'm not part of any group that's the reason I couldn't see it. It means we have to scrape group users?

Gulshanaggarwal avatar Oct 08 '22 14:10 Gulshanaggarwal

Yes!

On Sat, Oct 8, 2022 at 9:00 PM Gulshan aggarwal @.***> wrote:

I got it @nevo-david https://github.com/nevo-david. Thanks for the screenshot, actually I'm not part of any group that's the reason I couldn't see it. It means we have to scrape group users?

— Reply to this email directly, view it on GitHub https://github.com/linvo-io/linvo-scraper/issues/5#issuecomment-1272326971, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASA4VQ2BS2PGHEPX5EH5VN3WCF5BDANCNFSM6AAAAAARABVMHY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

--

Nevo David, Ceo & Founder at Linvo.io @.*** @.**>

linvo-io avatar Oct 08 '22 14:10 linvo-io

Hey @nevo-david I'm getting error when I run any script from package.json file.

see the image below->

Annotation 2022-10-09 230411

Gulshanaggarwal avatar Oct 09 '22 17:10 Gulshanaggarwal

Hey @nevo-david I'm getting error when I run any script from package.json file.

see the image below->

Annotation 2022-10-09 230411

Opearting System : Windows Node Version : 16.13.2

Gulshanaggarwal avatar Oct 09 '22 17:10 Gulshanaggarwal

Hey @nevo-david finally I got the solution. I think this problem is especially with Windows users. I just added node at starting of each script and it worked for me. I think we should add it the contribution guidelines so that user don't face issue like these? What do you say?

Gulshanaggarwal avatar Oct 09 '22 17:10 Gulshanaggarwal

Hi, I am experiencing the same problem, from a windows machine. I have added "node" at the beginning of the url of each script in the package.json file and it didn't work, can anyone help me, I have tried several options and I can't find the solution. Untitled

AlorenaP avatar Aug 08 '23 17:08 AlorenaP