Tom

Thanks. The documentation site isn't quite up to date. I may just switch to adding more notebooks in the docs subdirectory as I get around to documenting 0.2.x better.

There are two separate shuffles happening, shard shuffles and sample shuffles. Both are entirely under your control. By default, WebDataset just uses random.shuffle for shards and random.randint for samples, so...

The doc says: > Because files in IPFS are content-addressed and immutable, they can be complicated to edit. Mutable File System (MFS) is a tool built into IPFS that lets...

> would be against providing imlementation details in user documentation. How that happens does not (or should not) affect the usage of the feature. I'd say where the state is...

> There is no difference between that or any ipfs related data, everything is in ~/.ipfs. MFS could store state in memory/a daemon, in the current working directory, or in...

K8s has a lot of functionality for a lot of different applications. But as far as SoS is concerned, it would simply function like any other job queueing system. You...

> It is not easy to copy task files to k8s cluster since there is no "destination" per se. To solve this, we will have to copy the task file...

> > It was probably a bad design but SoS avoided using separate instances for > coordination. This made running sos scripts relatively easy but made a lot > of...

Ah, I see, just adding the option works: `microk8s enable gpu --set driver.enabled=false` This leaves the mystery of why this was working on two machines and failing on one.

There is no choice: Ubuntu desktop machines necessarily have the NVIDIA drivers installed; the only question is whether it's the Ubuntu repo or the NVIDIA repo. Microk8s is frequently used...