Feature request: Feed generator option to continue an existing feed
Currently the feed generator will take a snapshot of all data matching the parameters, generate the JSON representations and a manifest.
But for purposes of using the feed generator as a "cold storage" solution, it would be great if we could run it in an append mode where the manifest gets any event being dropped added.
Something like checking the manifest, taking the last update timestamp in the last event inserted and searching from that time?
If an old event is updated, the response to the search query returns the complete event, right?
Something like checking the manifest, taking the last update timestamp in the last event inserted and searching from that time?
If an old event is updated, the response to the search query returns the complete event, right?
Yup, that's correct. The idea would be to only add/update what has changed/was added and keep the previously generated events intact (unless there were modifications of course). This would allow users to clean up older events on their instances.