ExitStatus(unix_wait_status(256))

[nomeata]

I am experimenting with the magic-nix-cache action, as its promises are, well, very promising.

But I didn't see a any cache successes the second run, so I checked the logs of the first run (which was green), and saw something like this:

copying path '/nix/store/4fypqq7a3gb0zya8xp7c118lx773mwaq-Lean.Compiler.LCNF.ScopeM-c' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4gnlf7mpcjm5zw4ylxjd7225kkpgf34n-Simp.lean' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4hcgmi1d8s54rzvp22y5c90r9sklkj7d-Lean.Compiler.LCNF.ForEachExpr-ilean' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4hhqg62wi33qfas0dja6brxri2psjjxj-Lean.Meta.Tactic.Simp.Types' to 'http://127.0.0.1:37515/'...
disabling binary cache 'http://127.0.0.1:37515/' for 60 seconds
error (ignored): error: interrupted by the user
error: unable to download 'http://127.0.0.1:37515/nar/0gwppy6qb71y68695dv5g19p3blk8q9qcqj425yxzn4vd5fx6zvc.nar.zst': HTTP error 418
  2023-12-08T13:06:47.170849Z ERROR magic_nix_cache::util: Failed to upload batch: ExitStatus(unix_wait_status(256))
    at magic-nix-cache/src/util.rs:79

Retrying after error ERR_NON_2XX_3XX_RESPONSE, retry #: 1
  2023-12-08T13:06:48.252742Z  INFO magic_nix_cache::api: Workflow finished
    at magic-nix-cache/src/api.rs:50

  2023-12-08T13:06:48.264634Z  INFO magic_nix_cache::api: Pushing 3445 new paths
    at magic-nix-cache/src/api.rs:59

copying 2830 paths...
copying path '/nix/store/4hhqg62wi33qfas0dja6brxri2psjjxj-Lean.Meta.Tactic.Simp.Types' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4gnlf7mpcjm5zw4ylxjd7225kkpgf34n-Simp.lean' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4kqqbwpsjil0l9cnfil227bfwqy0la1j-src' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4ky7rfa0m79hrzvagyk99isk3x61p1qb-Lean.Server.GoTo-ilean' to 'http://127.0.0.1:37515/'...
disabling binary cache 'http://127.0.0.1:37515/' for 60 seconds
error (ignored): error: unable to download 'http://127.0.0.1:37515/nar/1cbmgnq3da1v61cyl89rpcca8iz55mbnblv3zfmysmsmrh09683v.nar.zst': HTTP error 418
error (ignored): error: unable to download 'http://127.0.0.1:37515/nar/0gwppy6qb71y68695dv5g19p3blk8q9qcqj425yxzn4vd5fx6zvc.nar.zst': HTTP error 418
error (ignored): error: unable to download 'http://127.0.0.1:37515/nar/0v5s192m949mx8hryz2jijmncbb9fl4746sral6ihjmb5vjd9s39.nar.zst': HTTP error 418
error: unable to download 'http://127.0.0.1:37515/nar/197hv5l2xcb8q26x23y0nqcy7zi8zgjqg7ml44wwn0i990nnbnvz.nar.zst': HTTP error 418
  2023-12-08T13:06:49.386032Z ERROR magic_nix_cache::util: Failed to upload batch: ExitStatus(unix_wait_status(256))
    at magic-nix-cache/src/util.rs:79

Retrying after error ERR_NON_2XX_3XX_RESPONSE, retry #: 2
  2023-12-08T13:06:51.430635Z  INFO magic_nix_cache::api: Workflow finished
    at magic-nix-cache/src/api.rs:50

  2023-12-08T13:06:51.442212Z  INFO magic_nix_cache::api: Pushing 3445 new paths
    at magic-nix-cache/src/api.rs:59

copying 2830 paths...
copying path '/nix/store/4gnlf7mpcjm5zw4ylxjd7225kkpgf34n-Simp.lean' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4hhqg62wi33qfas0dja6brxri2psjjxj-Lean.Meta.Tactic.Simp.Types' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/4kqqbwpsjil0l9cnfil227bfwqy0la1j-src' to 'http://127.0.0.1:37515/'...

Maybe these are too many small out paths?

Full log

A subsequent run has

copying path '/nix/store/bfcwp6rbnnxizq6shnnqdn3q4rl2m4rr-Init.Conv' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/bfhd9y1q3hpi0jfx0mlgw4fxyxv3vvdz-Lean.Elab.Tactic.Conv.Pattern-ilean' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/bfkxwyrinah65x9gvwn8sfqfkjmiarnl-Lean.Meta.Tactic.UnifyEq-c' to 'http://127.0.0.1:37515/'...
copying path '/nix/store/bfqqp8n1bj19bjybpffhivi3ymggwglr-ConfigOptions.lean' to 'http://127.0.0.1:37515/'...
error (ignored): error: while uploading to HTTP binary cache at 'http://127.0.0.1:37515/': error: unable to upload 'http://127.0.0.1:37515/nar/09gmanhjh8y6d6vm7nz7cszczp798cs1xgsyip93v8wmcll38x6r.nar.zst': HTTP error 418

              response body:

              GitHub API error: API error (429 Too Many Requests): StructuredApiError { message: "Request was blocked due to exceeding usage of resource 'Count' in namespace ''." }
error: while uploading to HTTP binary cache at 'http://127.0.0.1:37515/': error: unable to upload 'http://127.0.0.1:37515/bfcwp6rbnnxizq6shnnqdn3q4rl2m4rr.narinfo': HTTP error 418

              response body:

              GitHub API error: API error (429 Too Many Requests): StructuredApiError { message: "Request was blocked due to exceeding usage of resource 'Count' in namespace ''." }
  2023-12-08T16:35:00.829259Z ERROR magic_nix_cache::util: Failed to upload batch: ExitStatus(unix_wait_status(256))
    at magic-nix-cache/src/util.rs:79

Retrying after error ERR_NON_2XX_3XX_RESPONSE, retry #: 1
  2023-12-08T16:35:01.938691Z  INFO magic_nix_cache::api: Workflow finished
    at magic-nix-cache/src/api.rs:50

  2023-12-08T16:35:01.950952Z  INFO magic_nix_cache::api: Pushing 3445 new paths
    at magic-nix-cache/src/api.rs:59

copying 2293 paths...

which is maybe more helpful?

[peterbecich]

I see the upload error as well, in "Post Run ... magic-nix-cache-action":

GitHub API error: API error (429 Too Many Requests): 
  StructuredApiError { message: "Request was blocked due to exceeding usage of resource 'Count' in namespace ''." }

https://github.com/peterbecich/halogen-chess/actions/runs/7437149298/job/20234454167

Could exponential backoff or something similar be used here?