Alexander Berg

icon indicating a website link http://nyqui.st icon indicating an email [email protected]

icon company Hatstore World AB icon location Kalmar, Sweden icon location Coding CTO at @Hatstore. 🛠️ .NET, e-commerce, DevOps, infra

Results 4 comments of Alexander Berg
trafficstars

Pie chart

+1, would be awsome.

Drag and Drop has no effect

Could it be that you are running Tail Blazer as Administrator and the file is owned by someone else, or vice versa? I observe the same behaviour, navigating to the...

Add support for robots.txt

Hi, It is, but I do not use this project anymore. I'd recommend sjdirect/abot or another crawler that uses the new async HttpClient.

Add support for robots.txt

Sorry for the late reply, been away. There is not much to it really. I am using the APM Model (https://msdn.microsoft.com/en-us/library/ms228963(v=vs.110).aspx) in https://github.com/alexandernyquist/Harvest/blob/master/Harvest/Downloader.cs. Then there are two threads which controls...