aws_pricing_data_ingestor icon indicating copy to clipboard operation
aws_pricing_data_ingestor copied to clipboard

Published 20 hours ago • verified publisher icon Bjorn248
→

Metadata

Python script to download data from the AWS Pricing API and import it into MariaDB

Results 6 aws_pricing_data_ingestor issues
Sort by recently updated
recently updated
newest added

Migrate to cockroach DB

First we should choose an execution environment, the candidates are: * Github Actions (leaning towards this, as I've had nothing but good experiences with it) * AWS Lambda (the existing...

Bjorn248 avatar Bjorn248

Add terraform

Add all AWS Resources * SQS * Lambdas * producer * consumer

Bjorn248 avatar Bjorn248

Implement serverless framework

Bjorn248 avatar Bjorn248

store md5 in db so that CSVs do not have to be downloaded every time

Self explanatory. Will have to update schema, store md5 in the db, compare etag value to md5, skip file if they are the same, process file if the md5 is...

Bjorn248 avatar Bjorn248

Address all pylint issues, refactor code to be much more readable

Code is hacky, needs to be broken into more functions. Also, there are many pylint issues.

Bjorn248 avatar Bjorn248

Update dependencies

To address vulnerabilities

Bjorn248 avatar Bjorn248

← Metadata

12
Stars
2
Forks
Watchers

Owner

verified publisher icon Bjorn248

Metadata

Python script to download data from the AWS Pricing API and import it into MariaDB

Back