LinkCrawler icon indicating copy to clipboard operation
LinkCrawler copied to clipboard

Output to SqlLite db file

Open hmol opened this issue 8 years ago • 9 comments

hmol avatar Apr 21 '16 13:04 hmol

This seems straightforward enough. I would likely try to use Dapper to do this if that's okay with you? That could also mean that you could hypothetically add other other relational databases easily: SQL Server, MySQL, and so on. I would assume it would just be one simple table with the contents of IResponseModel inserted into each row?

mgroves avatar Apr 26 '16 02:04 mgroves

I have not used Dapper before, but to me it sounds very useful. So I really think you should use it :thumbsup: Contents of IResponseModel in each row is good yes

hmol avatar Apr 26 '16 05:04 hmol

Here's the gist of it: https://gist.github.com/mgroves/f48d3add58527e5324be525c56e5b2fd

mgroves avatar Apr 30 '16 16:04 mgroves

I should note that that sqlite file gets large pretty quickly. Perhaps only WriteError should write to the db?

mgroves avatar Apr 30 '16 16:04 mgroves

Yeah, that sounds very reasonable :+1:

hmol avatar May 02 '16 19:05 hmol

and other type of DB? like file nosql db? like https://github.com/mbdavid/LiteDB

dokkillo avatar Feb 08 '17 20:02 dokkillo

wow , no commit since then ha

d80ep08th avatar Jan 06 '20 12:01 d80ep08th

There is a PR (https://github.com/hmol/LinkCrawler/pull/34), should it just be merged and this issue closed?

bphermansson avatar Oct 17 '21 06:10 bphermansson

Is this issue yet not resolved? Can I contribute to this project?

hiteshbhavsar avatar Oct 14 '22 23:10 hiteshbhavsar