Keegan White

what host OS are you using? It looks like mac. If it is then change the mount locations to something docker has access to else it won't work.

error seems to be with updating apt: `ERROR [ 2/54] RUN apt-get update 58.6s`. Do you have internet connection?

What do you think of the following for the Historical Data Format (following a similar pattern to `manually_specified.yml`): ``` historical_changes: - stage: 4 start: 2023-08-31T14:00:00 finish: 2023-09-02T05:00:00 source: https://twitter.com/Eskom_SA/status/1697210092179935262 exclude:...

Agreed. I don't see a disadvantage in keeping the format the same. To explain my thought process for dealing with two files that have overlapping times or conflicting stages like...

I will have a look at this and get back to you but an issue (maybe something I missed?) is the different formatting of the manually_specified.yaml file. I can get...

@beyarkay have you had any time to generate some test yaml files? (I am also working on some). I have started some rudimentary test cases for a data aggregation file...