Anton Filimonov
Anton Filimonov
There has been no activity in glogg repository since April 2018 :( That is one of the reasons my fork exists. If @nickbnf is still interested in developing glogg, I...
Glogg is cpu bound on initial indexing due to end of line searching code (see discussion in #227). After initial reading if file is not too large it should stay...
I've done some benchmarking in klogg using plain vector for index as the most simple structure . For small files (about 1Gb) in single threaded mode there is about 5%...
+1 for sshfs )
@denis-bogdanas could you benchmark [klogg](https://github.com/variar/klogg) in same conditions? In this fork I've added parallel search and tuned indexing code a bit. Precompiled builds are available on [bintray](https://bintray.com/variar/generic/klogg/17.12.0#files). Also "matches overview"...
Either [klogg-17.12.0.245-setup.exe](https://bintray.com/variar/generic/download_file?file_path=win%2Fklogg%2Fklogg-17.12.0.245-setup.exe) or [klogg-17.12.0.245-portable.zip](https://bintray.com/variar/generic/download_file?file_path=win%2Fklogg%2Fklogg-17.12.0.245-portable.zip). Portable version does not require any installation, just unpack the zip archive. These precompiled binaries are only for 64 bit systems.
Thanks for the feedback. Several things come to mind: 1. QFile::open api does not allow to pass flags for sequential access, so OS can't optimize caching and prefetching. I think...
I've done some research. Adding posix_fadvise(...,POSIX_FADV_SEQUENTIAL) make file reading actually slower on my pc. I'll test FILE_FLAG_SEQUENTIAL_SCAN on Windows later. Adding separate thread to read data from file and pass...
FYI, switching from naive loop to std::memchr when searching for line breaks and tabs makes initial file load IO-bound on my 850 EVO. Changes are needed in one loop, I'll...
Not reproduced for x64 build. Latest 32-bit build has this issue.