incubator-pagespeed-mod icon indicating copy to clipboard operation
incubator-pagespeed-mod copied to clipboard

RateController: drop deferred fetch of image

Open Atycyber opened this issue 5 years ago • 10 comments

Hi,

I keep having the following warning message in Apache log for every few minutes RateController: drop deferred fetch of https://[IP]/images/01.jpg on shutdown

I enable mod_speedpage for one of my virtual domains on the server so far, whereas the image is not accessable from the IP base path because of web server setting, but it available on domain base path like https://[VIRTUAL_DOMAIN_NAME]/images/01.jpg

It looks like mod_speedpage try to get the image for optimize from the server IP itself. And my question is how can I configure mod_speedpage to access the image in domain base path instead of IP path or use local path.

Thank you very much. Anthony

Atycyber avatar Aug 09 '19 07:08 Atycyber

Hi What´s the value of ModPagespeedRewriteRandomDropPercentage Percent? Percent is a value between 0 and 100. https://www.modpagespeed.com/doc/config_filters#RewriteRandomDropPercentage

Lofesa avatar Aug 11 '19 20:08 Lofesa

Hi The parameter is disabled in my conf file #ModPagespeedRewriteRandomDropPercentage 90

Atycyber avatar Aug 12 '19 04:08 Atycyber

Hi At the moment I can't have access to the GitHub web, so I send this email directly. Uncomment and change the 90 to -1, no rate limits. I think that the parameter have a default value, so you must change to overwrite the default.

El lun., 12 ago. 2019 6:59, Atycyber [email protected] escribió:

Hi The parameter is disabled in my conf file #ModPagespeedRewriteRandomDropPercentage 90

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/apache/incubator-pagespeed-mod/issues/1937?email_source=notifications&email_token=AFKOZCICVHEY637EWIYLYOLQEDU4HA5CNFSM4IKRG532YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD4BSHIQ#issuecomment-520299426, or mute the thread https://github.com/notifications/unsubscribe-auth/AFKOZCLMSPJ57CGIHUGV5ETQEDU4HANCNFSM4IKRG53Q .

Lofesa avatar Aug 12 '19 10:08 Lofesa

Hi Lofesa,

Thanks for your suggestion, I changed the setting to be -1 and monitor it for a couple of hours, the warning message still appending to log file quite frequently. If this is not serious message how can I turn it off or ignore warning message?

Atycyber avatar Aug 13 '19 09:08 Atycyber

Hi @Atycyber Sorry for coming late, but I was out on holidays. Can you post or attach you config (pagespeed and apache)?

Lofesa avatar Aug 26 '19 00:08 Lofesa

HI Lofesa,

Sorry for my very late reply and I was back from business trip. The pagespeed conf:

<IfModule !mod_version.c> LoadModule version_module /usr/lib64/httpd/modules/mod_version.so </IfModule>

<IfVersion < 2.4> LoadModule pagespeed_module /usr/lib64/httpd/modules/mod_pagespeed.so </IfVersion> <IfVersion >= 2.4.2> LoadModule pagespeed_module /usr/lib64/httpd/modules/mod_pagespeed_ap24.so </IfVersion>

<IfModule !mod_deflate.c> LoadModule deflate_module /usr/lib64/httpd/modules/mod_deflate.so </IfModule> <IfModule pagespeed_module> ModPagespeed on

ModPagespeedInheritVHostConfig on

AddOutputFilterByType MOD_PAGESPEED_OUTPUT_FILTER text/html

ModPagespeedFileCachePath "/var/cache/mod_pagespeed/"

ModPagespeedLogDir "/var/log/pagespeed"

ModPagespeedSslCertDirectory "/etc/pki/tls/certs"
ModPagespeedSslCertFile /etc/pki/tls/cert.pem

ModPagespeedCreateSharedMemoryMetadataCache "/var/cache/mod_pagespeed/" 51200
ModPagespeedEnableFilters prioritize_critical_css
ModPagespeedEnableFilters defer_javascript
ModPagespeedEnableFilters sprite_images
ModPagespeedEnableFilters collapse_whitespace,remove_comments
ModPagespeedEnableCachePurge on


ModPagespeedEnableFilters lazyload_images
ModPagespeedEnableFilters rewrite_images
ModPagespeedEnableFilters responsive_images,resize_images


ModPagespeedFetchHttps enable

ModPagespeedDisallow "*/wpcallback.php"
ModPagespeedFileCacheInodeLimit        500000

ModPagespeedRewriteRandomDropPercentage -1
ModPagespeedPrivateNotVaryForIE on
ModPagespeedMaxSegmentLength 250
<Location /pagespeed_admin>
    Order allow,deny
    Allow from localhost
    Allow from 127.0.0.1
    Allow from XXX.XXX.XX.XX
    SetHandler pagespeed_admin
</Location>
<Location /pagespeed_global_admin>
    Order allow,deny
    Allow from localhost
    Allow from 127.0.0.1
    Allow from XXX.XXX.XX.XX
    SetHandler pagespeed_global_admin
</Location>

ModPagespeedStatisticsLogging on

ModPagespeedMessageBufferSize 100000

And the apache is config in standard way, and the log file is under R/W directly and only by pagespeed module so I only show the above config here.

Thanks a lot for review.

Atycyber avatar Sep 18 '19 03:09 Atycyber

Hi @Atycyber My bad, the ModPagespeedRewriteRandomDropPercentage parameter must be set to 0 to not discard any rewrite, valid values are from 0 to 100.

Lofesa avatar Sep 18 '19 07:09 Lofesa

HI Lofesa, OK, I change to 0 for the parameter now, will let it keep running for 1-2 days, get back to you about the result later

Atycyber avatar Sep 20 '19 07:09 Atycyber

Hi Lofesa,

Just checked the log, it looks like the same to the old setting. It keeps writing the same warning to log for every 2-3 minutes. :-(

Atycyber avatar Sep 24 '19 03:09 Atycyber

Hi @Atycyber Maybe you have a redirect/rewrite from [IP] to [SUB-DOMAIN]? In the html code the requests are https://[VIRTUAL_DOMAIN_NAME]/images/01.jpg ? Try to auth the domain: ModPagespeedDomain http*://*:example.com As stated in the doc, pagespeed try to fecht resources that belong to the auth domain it found in the html.

EDIT: As a last resource you can try to load files directly from disk with ModPagespeedLoadFromFile

Lofesa avatar Sep 24 '19 08:09 Lofesa