show stats for each job

[kalombos]

I added some stats information for complted jobs table. Here is how it looks

[DormyMo]

wow, what a clever implementation, let me try it.

[DormyMo]

i afraid of a large size log will make the service very slowly

[iamumairayub]

I get following error when I run your forked repo of SpiderKeeper

scrapers@my-scrapers:~/my_spiders$ spiderkeeper
Unhandled Error
Traceback (most recent call last):
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/application/app.py", line 674, in run
    runApp(config)
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/scripts/twistd.py", line 25, in runApp
    runner.run()
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/application/app.py", line 381, in run
    self.application = self.createOrGetApplication()
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/application/app.py", line 453, in createOrGetApplication
    application = getApplication(self.config, passphrase)
--- <exception caught here> ---
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/application/app.py", line 464, in getApplication
    application = service.loadApplication(filename, style, passphrase)
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/application/service.py", line 416, in loadApplication
    application = sob.loadValueFromFile(filename, 'application')
  File "/home/scrapers/.local/lib/python3.7/site-packages/twisted/persisted/sob.py", line 177, in loadValueFromFile
    eval(codeObj, d, d)
  File "/usr/local/lib/python3.7/dist-packages/SpiderKeeper/scrapyd/txapp.py", line 5, in <module>
    application = create_spiderkeeper_application(Config())
  File "/usr/local/lib/python3.7/dist-packages/SpiderKeeper/scrapyd/app.py", line 12, in create_spiderkeeper_application
    flask_app = create_flask_application(flask_config)
  File "/usr/local/lib/python3.7/dist-packages/SpiderKeeper/app/__init__.py", line 52, in create_flask_application
    register_extensions(app)
  File "/usr/local/lib/python3.7/dist-packages/SpiderKeeper/app/__init__.py", line 36, in register_extensions
    init_database(app)
  File "/usr/local/lib/python3.7/dist-packages/SpiderKeeper/app/__init__.py", line 32, in init_database
    db.create_all()
  File "/usr/local/lib/python3.7/dist-packages/flask_sqlalchemy/__init__.py", line 963, in create_all
    self._execute_for_all_tables(app, bind, 'create_all')
  File "/usr/local/lib/python3.7/dist-packages/flask_sqlalchemy/__init__.py", line 955, in _execute_for_all_tables
    op(bind=self.get_engine(app, bind), **extra)
  File "/usr/local/lib/python3.7/dist-packages/flask_sqlalchemy/__init__.py", line 896, in get_engine
    return connector.get_engine()
  File "/usr/local/lib/python3.7/dist-packages/flask_sqlalchemy/__init__.py", line 556, in get_engine
    self._sa.apply_driver_hacks(self._app, info, options)
  File "/usr/local/lib/python3.7/dist-packages/flask_sqlalchemy/__init__.py", line 861, in apply_driver_hacks
    info.database = os.path.join(app.root_path, info.database)
builtins.AttributeError: can't set attribute


Failed to load application: can't set attribute