Pierce Stegman

icon indicating a website link https://pwstegman.me icon indicating an email [email protected]

icon company Google icon location New York, New York icon location Machine learning researcher and software engineer. I work on natural language processing problems and brain-computer interfaces. M.S. in Computer Science.

Results 5 comments of Pierce Stegman

Multitaper method

Moved to [v1.9](https://github.com/pwstegman/bci.js/tree/v1.9) to allow time for adding support of cubic spline interpolation of discrete prolate spheroidal (Slepian) sequences

Most performant way to pass data JS/WASM context

I was looking for how to copy arrays to/from WebAssembly and came across this thread. For anyone else, I was able to copy arrays over using [AssemblyScript](https://github.com/AssemblyScript/assemblyscript) and @torch2424's library...

ZeRO 2 cpu_offload causes RuntimeError: expected input to be on cuda

Thanks for the reply! I installed directly from the requirements.txt files, so DeeperSpeed was installed. I've trained using ZeRO 1 without issue; the error only occurs once I've made the...

ZeRO 2 cpu_offload causes RuntimeError: expected input to be on cuda

@StellaAthena Just tried setting pipeline parallelism to 0 (model parallel was 1) and got the same error. Traceback NeoXArgs.from_ymls() ['configs/small_offload.yml', 'configs/local_setup.yml'] INFO:root:NeoXArgs.calculate_derived() Total number of GPUs determined to be: 4...

Negative document indices caused by 64 bit integer stored in a 32 bit integer array.

Great, I'll get to working on a PR! Realistically I won't be able to train on 10 epochs. I was just changing around parameters on the config and running little...