bigslice
bigslice copied to clipboard
grailbio
A serverless cluster computing system for the Go programming language
Right now, these aren't caught until we try to gob-encode. Consider failing faster in type-checking to avoid too much confusion/loss when it works with local execution.
Bumps [tzinfo](https://github.com/tzinfo/tzinfo) from 1.2.9 to 1.2.10. Release notes Sourced from tzinfo's releases. v1.2.10 Fixed a relative path traversal bug that could cause arbitrary files to be loaded with require when...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.11.2 to 1.13.6. Release notes Sourced from nokogiri's releases. 1.13.6 / 2022-05-08 Security [CRuby] Address CVE-2022-29181, improper handling of unexpected data types, related to untrusted inputs to...
Bumps [addressable](https://github.com/sporkmonger/addressable) from 2.7.0 to 2.8.0. Changelog Sourced from addressable's changelog. Addressable 2.8.0 fixes ReDoS vulnerability in Addressable::Template#match no longer replaces + with spaces in queries for non-http(s) schemes fixed...
Address https://github.com/grailbio/bigslice/security/dependabot/docs/Gemfile.lock/nokogiri/open by upgrading `github-pages` gem.
This is a concept for making data reading simpler than `ReaderFunc` by allowing "normal" Go state (in a closure). ```lang=go slice := bigslice.PushReader(Nshard, func(shard int, push func(string, int)) error {...
We had a few recent new Bigslice users. This is an umbrella issue that covers several small things we're going to do to try to address some of the pain...
This is designed to run as a golangci-lint linter, however I haven't set up a plugin binary yet so far now it just runs as a standalone binary. It's simple...
Support different instance types per computation. It's sometimes the case that users want different instance types for different invocations. For example, one computation may require instances with GPUs. It would...
This might be a super easy performance win for workloads that shuffle a lot of data. (@mariusae noted this internally; putting here to share).