nibbler icon indicating copy to clipboard operation
nibbler copied to clipboard

Problems with cyrillic names of the folders

Open AndrewTCEC opened this issue 3 years ago • 24 comments

Basically if any folder has it's name in Cyrillic, Nibbler is going bonkers. Can't load the nets and TBs, only engine load itself works fine. Any ideas?

AndrewTCEC avatar Mar 11 '21 17:03 AndrewTCEC

Can you post an example of such a path?

rooklift avatar Mar 11 '21 20:03 rooklift

It's possible it's related to https://github.com/LeelaChessZero/lc0/issues/1474

rooklift avatar Mar 11 '21 20:03 rooklift

It's possible it's related to LeelaChessZero/lc0#1474

Possible, but the engine itself loads properly while nets and TBs don't. Here are some pics. Engine itself is located in the same "Engines" directory and in a same folder as the net and loads well and clear as I said. image image

AndrewTCEC avatar Mar 11 '21 20:03 AndrewTCEC

the engine itself loads properly

Nibbler loads the engine but then passes network and TB paths via setoption, which is what's claimed to be broken in the linked issue. Can you try using setoption directly in the console app?

rooklift avatar Mar 11 '21 20:03 rooklift

This is... how?

AndrewTCEC avatar Mar 11 '21 20:03 AndrewTCEC

That is, try running lc0.exe directly and doing:

setoption name WeightsFile value PATH

But replace PATH with the full absolute path (the bottom blue text in your screenshot).

I would predict Lc0 will emit the same error message, meaning it's an Lc0 problem.

rooklift avatar Mar 11 '21 20:03 rooklift

Okay

AndrewTCEC avatar Mar 11 '21 21:03 AndrewTCEC

You might need to also type...

go infinite

...afterwards (on a new line) just to get it to actually load. In other words, the full thing to do is:

setoption name WeightsFile value PATH
go infinite

rooklift avatar Mar 11 '21 21:03 rooklift

Yeah, tried it for the net, no Cyrillic - fine, yes Cyrillic - not fine. This one is an Lc0 issue. But what about TBs? They have the same issue. image

AndrewTCEC avatar Mar 11 '21 21:03 AndrewTCEC

I guess it's the same root cause in Lc0's code.

rooklift avatar Mar 11 '21 21:03 rooklift

Okay. Will wait for a fix patiently.

AndrewTCEC avatar Mar 11 '21 21:03 AndrewTCEC

By the way, you might want to give them a nudge about this.

rooklift avatar Apr 02 '21 22:04 rooklift

An update on the problem: in Nibbler 2.1.4 the warning is now ensilenced (the path pick goes without a hitch), but the problem is still present: trying to run Fish in KBN v K endgame (4-men) with 5-men TBs has no TB hits from Stock.

AndrewTCEC avatar Apr 11 '21 06:04 AndrewTCEC

Hmm. Can you enable logging with the menu Dev --> Logging and turn on everything in the submenu. Then try it and post the log here please.

rooklift avatar Apr 11 '21 09:04 rooklift

Here: https://drive.google.com/file/d/19QDx0RzrSJOQNw7-c0yuIYQDmofMhvtn/view?usp=sharing, https://drive.google.com/file/d/1Br_jzaK1ugxnUFK-y2pllQ92UEHd_nMA/view?usp=sharing, https://drive.google.com/file/d/1Y2T91Cq4TtlFe88k19PNaT5S7d-7l_ND/view?usp=sharing

AndrewTCEC avatar Apr 11 '21 16:04 AndrewTCEC

In a nutshell: If you set a SF NetPath with a Cyrillic folder, it crashes. If you set a TB Path with a Cyrillic folder, it's reading fails and SF continues without TBs. If there is no Cyrillic in Path, SF runs perfectly fine.

AndrewTCEC avatar Apr 11 '21 16:04 AndrewTCEC

By netpath you mean using a Stockfish EvalFile?

What happens if (as before) you try testing in Stockfish directly? Double-click on stockfish.exe or whatever it's called, and do the following:

setoption name EvalFile value PATH
go infinite

(Replacing PATH with the exact absolute path to the network file.)

rooklift avatar Apr 11 '21 16:04 rooklift

Actually it's not working for me either, even on boring ASCII paths. Not sure why, I'll look into it.

rooklift avatar Apr 11 '21 17:04 rooklift

By netpath you mean using a Stockfish EvalFile?

Yes, I do. Btw, I forgot to tell you, that the default setting of the integrated net looks to be fine.

I managed to test it out and... same thing as Leela on the net! Really?

AndrewTCEC avatar Apr 11 '21 17:04 AndrewTCEC

Where did you get the net? I've asked on the Stockfish Discord and many of the nets available at https://tests.stockfishchess.org/nns are incompatible with SF13.

rooklift avatar Apr 11 '21 17:04 rooklift

I downloaded there, but I downloaded the actual default net just like it is delivered in abrok.eu builds. Net in a path with Cyrillic folder included is picked, but trying to 'go infinite' the application just closes/crashes. Path with no Cyrillic works perfectly. TBs are a bit different: Cyrillic path shows 0 TBs found (search probably goes fine without TBs, not tested), non-Cyrillic works fine (reads the TBs properly). That is what I got.

AndrewTCEC avatar Apr 11 '21 17:04 AndrewTCEC

Looks identical to Leela's problem... if this happens even when opening SF in console then it's not a Nibbler issue.

rooklift avatar Apr 11 '21 17:04 rooklift

But then I wonder how Arena handles this like it's nothing... Tried it within the console of Arena with both Leela and Fish, everything runs fine! Is some kind of "Translator" used or what?

AndrewTCEC avatar Apr 11 '21 17:04 AndrewTCEC

That's curious and I have no idea.

Stockfish has an issue about this now: https://github.com/official-stockfish/Stockfish/issues/3424

rooklift avatar Apr 11 '21 18:04 rooklift