aws_pricing_data_ingestor icon indicating copy to clipboard operation
aws_pricing_data_ingestor copied to clipboard

Published 20 hours ago • verified publisher icon Bjorn248

store md5 in db so that CSVs do not have to be downloaded every time

Open Bjorn248 opened this issue 6 years ago • 0 comments

Self explanatory. Will have to update schema, store md5 in the db, compare etag value to md5, skip file if they are the same, process file if the md5 is different.

Do some research to determine if md5 is still viable for this purpose

Bjorn248 avatar Dec 30 '18 00:12 Bjorn248