pimcore-lucene-search icon indicating copy to clipboard operation
pimcore-lucene-search copied to clipboard

https 301 redirect

Open paulboenisch opened this issue 6 years ago • 3 comments
trafficstars

Q A
Bug report? yes
Feature request? no
BC Break report? no
RFC? no

There are no pages crawled if https redirect present.

paulboenisch avatar Jul 17 '19 13:07 paulboenisch

I forgot how I solved this issue earlier so I'm leaving a comment here to remember it next time. You can use https redirects but you have to allow the scheme. Sample config.yml:

lucene_search:
    enabled: true
    allowed_schemes: ['https']
    seeds:
        - 'https://yourdomain.com/'
    filter:
        valid_links:
            - '@^https://yourdomain.com.*@i'
    view:
        max_per_page: 10
    crawler:
        content_max_size: 4
        content_start_indicator: '<body>'
        content_end_indicator: '</body>'

Cruiser13 avatar Oct 25 '20 11:10 Cruiser13

@Cruiser13 Just so you know, this bundle is sort of deprecated and will be replace with dynamic-search.... so better not use it anymore.

dpfaffenbauer avatar Oct 27 '20 07:10 dpfaffenbauer

@dpfaffenbauer yes I know but we could not get dynamic-search to work the way we need it to so far (docs are missing too). And we got nice integrations with coreshop product search and this bundle so we will continue using it for a while I think.

Cruiser13 avatar Oct 27 '20 08:10 Cruiser13