crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

[Bug]: CrawlResult Links not taking into account base tag

Open poryan opened this issue 6 months ago • 0 comments

crawl4ai version

0.6.3

Expected Behavior

The links array in CrawlResult should be derived based on if there is a base tag on the page.

On http://xyz.com/hello/world

should navigate to http://xyz.com/abc.pdf

Current Behavior

It current does not take into account the base tag and generates an href relative to the current page

Is this reproducible?

Yes

Inputs Causing the Bug


Steps to Reproduce


Code snippets


OS

All

Python version

3.11

Browser

Chrome

Browser version

No response

Error logs & Screenshots (if applicable)

No response

poryan avatar May 22 '25 20:05 poryan