parse error: line 254675: non resumable parse error: context deadline exceeded

[szinn]

On large lists, I'm getting parse error: line 254675: non resumable parse error: context deadline exceeded consistently after a random number of lines.

The result is the full block list isn't loaded, but the ones loaded overwrite the current list. There also doesn't seem to be a retry.

This is problematic - if the full ad list can't be fetched, it shouldn't be processed at all.

Propose that the list is fetched to a temporary local storage and only if successful, process list.

In addition, if the list isn't retrievable, then retry according to the retry settings.

May 23 09:58:08 titan blocky[27382]: [2024-05-23 09:58:08] ERROR list_cache: parse error: line 254675: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body) count=254560 source=https://blocklistproject.github.io/Lists/malware.txt```

[kwitsch]

You could increase the timeout which is set to five seconds by default:

blocking:
  loading:
    downloads:
      timeout: 30s # for example (default: 5s)

[github-actions[bot]]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stalled for 5 days with no activity.