haystack icon indicating copy to clipboard operation
haystack copied to clipboard

Published 20 hours ago • verified publisher icon deepset-ai

Support for Crawler in Haystack 2.x

Open tewnut opened this issue 1 year ago • 4 comments

Haystack 2.0 should support user intention to add the Crawler in a similar way that was supported in version 1.x

Additional Information: Discord Discussion Link: Discord Discussion

tewnut avatar Dec 21 '23 09:12 tewnut

Can I work on this? I recently fixed a bug in the crawler class, so I am familiar with the code. I can create a draft PR and ask for clarifications/feedback along the way.

mohitlal31 avatar Mar 12 '24 15:03 mohitlal31

Can I work on this? I recently fixed a bug in the crawler class, so I am familiar with the code. I can create a draft PR and ask for clarifications/feedback along the way.

@anakin87 Are you'll planning to take this up on your own? I'd love to work on this if it's not already in your pipeline.

mohitlal31 avatar Mar 14 '24 16:03 mohitlal31

hi folks, is someone working on porting the crawler?

PGryllos avatar Apr 28 '24 20:04 PGryllos

Hi @anakin87,

Any plans on picking this up ? I noticed @mohitlal31 already offered to help.

sachinsachdeva avatar Aug 10 '24 23:08 sachinsachdeva