csvmatch

csvmatch copied to clipboard

Add other fuzzy matching algorithms

15

There's a list here: http://ntz-develop.blogspot.co.uk/2011/03/fuzzy-string-search.html

maxharlow

One option to specify fields to use to create the blocks, another (?) to set the method -- default to exact match, options for Metaphone etc Interesting bit on Soundex...

maxharlow

For the purpose of matching strings with helpful numbers and unhelpful words (such as precinct names with codes and messy names), adding an "ignore_letters" option would be nice. This would...

hjohns12

Investigate speed/memory improvements

3

eg: * generators and generator comprehensions * `cStringIO`, and other C-versions * streaming output? (probably required before #11) * write some performance tests

maxharlow

Speed up with memory mapping?

1

Could use something like Apache Arrow so files don't have to be kept in memory?

maxharlow

A la https://news.ycombinator.com/item?id=18613806

maxharlow

Using Nameparser? https://pypi.python.org/pypi/nameparser

maxharlow

Parameter to include original line numbers in output

3

maxharlow

A la how `csvlink` and `csvmatch` does by default.

maxharlow