Nicolas Williams
Nicolas Williams
### 3. Where corrections were received, such as to name or address, did these ever come via the stream, or only in bulk data? ```diff 2714c2677 < "nationality": "English,Nigerian", ---...
### 4. Is our transformed BODS data actually up-to-date, properly taking into account name changes, etc.? ```diff 2714c2677 < "nationality": "English,Nigerian", --- > "nationality": "British", ``` https://register.openownership.org/entities/2537715391486389948 Up-to-date in Register....
### 5. What are the consequences of etags not matching between the stream and bulk data on https://github.com/openownership/register/issues/254 and https://github.com/openownership/register/issues/255 ? If etags don't match, the update will be processed,...
### Fields sample Another sample was taken, without going into as much depth. For that a small file (over 100 lines) ingested via streaming was considered, it's self-link identifiers extracted,...
Blocks #164 QA.
@spacesnottabs, @StephenAbbott, what is the testing status of this ticket, please?
I'm not sure whether this should be in testing, @StephenAbbott, if there's still work to do. But maybe this relates to other tickets (or other tickets will be created)?
Noting here that I'm going with the conclusions of https://github.com/openownership/register/issues/247 . That means using Airbrake, at present, but with the flexibility to change quite easily if the need arises (e.g....
Clarification from PDF about meaning of PSC-STM-B section: ### Part B: Continuous Transformation **Goal** The goal is to replace the bulk transformation from S3 for processing PSC records with transforming...
It was found that the existing Transformer PSC streaming code already handled storage of stream pointers, including for multiple shards. Some experiments with this code were made, and things seem...