dolma

dolma copied to clipboard

Potential race condition

5

I have been looking into https://github.com/allenai/dolma/blob/main/src/bloom_filter.rs Specifically how it was thread-safe ``` pub fn contains_hashes(&self, hashes: &Vec) -> bool { for hash in hashes { let hash = *hash as...

chris-ha458

Add Style Guide and Pre-commit.

2

I would really love a proper contributing.md document styleguide and precommit. _Originally posted by @chris-ha458 in https://github.com/allenai/dolma/issues/23#issuecomment-1685029747_

soldni