Hakrawler does not support/handle <meta http-equiv="Refresh"...> redirect tags

[kaiksi-bb]

If a root path of a site has the <meta http-equiv="Refresh"...> tag, crawler can't handle it! Leading to a lot of URLs not being crawler correctly due to having that tag in the root path, redirecting to /home or any other path