Sander Land

avoidMoves on large part of symmetric board results in no results

3

Related to https://www.reddit.com/r/baduk/comments/pr9hth/katrain_can_i_analyze_one_coordinate_only/ ``` {"rules": "japanese", "priority": 101, "analyzeTurns": [0], "maxVisits": 1000, "komi": 6.5, "boardXSize": 19, "boardYSize": 19, "includeOwnership": false, "includeMovesOwnership": false, "includePolicy": false, "initialStones": [], "initialPlayer": "B", "moves": [],...

requirements and md fixes

Breaking changes in v0.19.1 for tiktoken/llama3

6

``` import tokenizers def show_tokenization(tok, s): ids = tok.encode(s, add_special_tokens=False).ids print([(i, tok.decode([i])) for i in ids]) def show_tokenization_from_id(tok, id): s = tok.decode([id]) print(f"id {id} decodes to {s!r}, which encodes to...")...

The dataset on huggingface contains many empty instructions. You can find these using: ```python import datasets ds = datasets.load_dataset("WizardLM/WizardLM_evol_instruct_V2_196k") empty_ids = [] for r in ds['train']: if r['conversations'][0]['value']=='': print(r) empty_ids.append(r['idx'])...