Request count in Hbase backend

[RajatGoyal]

If I use HBase backend, how can i count how many request a spider has made, and how many requests have got error? The Hbase API for counting of rows is very slow, is there a provision in frontera to get the count of requests made, and total error occurred.

[sibiryakov]

There are stats in DB worker and SW worker. You could try to see if these stats are available by means of JSONRPC. There are such things like batches after start and they should log errors if logging is set up properly.