Daniël de Kok
Daniël de Kok
We are using BLIS in [spaCy](https://github.com/explosion/spaCy) and have encountered access violations in CI when running on Windows, since updating to BLIS 0.9.0. I have tried to reproduce this issue with...
First of all, thanks a lot for this really nice DNS client! dog was recently packages in nixpkgs. I have opened a pull request to also add the shell completions...
``` % export OMP_NUM_THREADS=1 % python -m blis.benchmark Setting up data for gemm. 1000 iters, nO=384 nI=384 batch_size=2000 Blis gemm... Total: 11032014.6484375 9.54 seconds Numpy (openblas) gemm... Total: 11032015.625 9.50...
When building against `tch-sys`, libgomp is linked twice: ``` $ ldd target/release/syntaxdot | grep libgomp libgomp.so.1 => /nix/store/9ilyrqidrjbqvmnn8ykjc7lygdd86g7q-gcc-10.2.0-lib/lib/libgomp.so.1 (0x00007f8bc2423000) libgomp-75eea7e8.so.1 => /nix/store/kmwv690gyslwrf9ymqwv9q2xadnhs7hr-libtorch-1.8.1/lib/libgomp-75eea7e8.so.1 (0x00007f8bc17d1000) ``` The first occurrence is added through...
On top of `default.nix`: ``` let arx' = haskellPackages.arx.overrideAttrs (o: { patchPhase = (o.patchPhase or "") + '' substituteInPlace model-scripts/tmpx.sh \ --replace /tmp/ \$HOME/.cache/ ''; }); ``` However, this does...
We use sentence splitting in the biaffine parser to keep the O(n^2) biaffine attention model tractable. However, since the sentence splitter makes errors, the parser may not have the correct...
While reimplementing finalfusion-inspector in Rust, I bumped into a small annoyance. The `analogy` method takes an array of `&str`: `query: [&str; 3]` However, oftentimes you have a [String; 3]. We...
Add support for pruning embeddings, where N embeddings are retained. Words for which embeddings are removed are mapped to their nearest neighbor. This should provide more or less the same...
I think it would be nice to have a small utility data structure to fetch pretrained embeddings. I don't think this needs to be part of the `finalfusion` crate, since...
The vast majority of time during training is spent in the dot product and scaled additions. We have been doing unaligned loads so far. I have made a quick modification...