gpt-crawler icon indicating copy to clipboard operation
gpt-crawler copied to clipboard

extracting text in hidden div blocks

Open udgithub opened this issue 11 months ago • 0 comments

Hello !

I like your gpt-crawler, but sometimes it does not return all text within a page. E.g. on the FAQ page of our computing center users find all questions but our CMS hides the answers by using style information like this: style="height: 0px; overflow: hidden; display: none;" Unfortunately your crawler does not return the answers. Is it possible or configurable to make your crawler return also hidden text?

Thanks a lot in advance for your help and time.

Best regards, Uwe

udgithub avatar Mar 08 '24 09:03 udgithub