mxdev88

add option for using a single database

1

This PR implements an option for ScrapydWeb to use a single database. This is useful when used in environement where user does not have the priviliege to create database (e.g....

[Feature][API] scheduler start, shutdown, pause, resume

2

While it's possible to pause, resume, run an individual job through the API, it's not possible to modify the state of the sheduler itself. Would it be possible to add...

Add Flask context automatically to APScheduler executors

5

This PR adds the Flask context to added or modified jobs automaticall. Most of the time when using Flask-APScheduler, you need to access something from your Flask app which requires...

Change the __bind_key__ dynamically on model before querying?

2

I need to retrieve data from several databases, same data model, different data. ```py class SomeModel(db.Model): id = db.Column(db.Integer, primary_key=True, nullable=False) site = db.Column(db.String) other = db.Column(db.String) ``` ```py app...

expand environment variables in scrapy.cfg

5

Most CD pipeline frameworks heavily use environnent variables to store secrets and configuration. Currently, we need to either store these secrets in `scrapy.cfg` and commit to the repo or substitute...

Add environment variables expansion in scrapy.cfg

1

This PR implements #105.

scrapyd-client not using authentication config to reach scrapyd unlike scrapyd-deploy

1

When using scrapyd-deploy, the command uses the authentication configuration in `scrapy.cfg` (username/password) to perform BasicAuth. When using other commands, it fails. ```sh $ scrapyd-client projects Received a malformed response: Unauthorized...

Add support for partially written numbers and numbers in text2num

4

Currently, partially written numbers throw ValueError. It would be an interesting addition to handle such cases. ``` >> text2num('10 millions', 'fr') ValueError: invalid literal for text2num: '10 millions' ``` Expected...

Add function to map MIC to yahoo suffix

1

In most cases, Yahoo Finance builds its symbol from the ticker symbol + a [yahoo market suffix](https://help.yahoo.com/kb/finance-for-web/SLN2310.html;_ylt=AwrJKiCZFo9g3Y8AsDWPAwx.;_ylu=Y29sbwMEcG9zAzEEdnRpZAMEc2VjA3Ny?locale=en_US) It would be quite useful if the ```yfinance``` had a built in way...

It would be quite handy to be able to copy a job definition. Very often we need to schedule similar job with slightly different parameters. As of now, we create...