shawn

I'm helping take over last step here of running a range on cloud to confirm indexes are built out. Initially will build for 07/01 - 07/31 to confirm.

@Shaptic , looking into alternative k8s job for batch processing in lieu of AWS batch in short term. needs some adjustment on cluster to support JOB_COMPLETION_INDEX per https://github.com/stellar/ops/issues/1790

status update, running map/reduce jobs on k8s, identified some issues with slow performance of reduce jobs when running against s3 index. next step, adding logging into reduce, capture time spent...

after discussion with @Shaptic , the partial index data loaded onto s3 will suffice for mvp criteria, therefore will move this ticket to done, and carved out new ticket for...

Hello @jcx120 , we checked out the performance on this query. Related to observations on more 503's, this looks like it lines up, one ticket included on changes in the...

@jcx120 , this appears to be duplicate, reporting slow query response situation on cb API path as reported on #4455 , which had a PR merged for fix - https://github.com/stellar/go/pull/4477,...

> Can't we piggyback on the retention count cmdline flag? yes, definitely, updated description to be clear about that usage.

@2opremio , @bartekn , wondering if could remove the `backfill_queue` aspect just to explore simplicity, the new backfill process invokes the ingestion engine regularly on scheduled intervals, triggering the latest...

> BTW, we may also need to think about garbage collection (what if a filter is updated to not include certain accounts anymore, should we care about the data left...

@jcx120 , can. you provide a bit more details on acceptance criteria? i.e. do you expect an automated comparison report as part of CI build/integration test output or an ad-hoc...