stroom
stroom copied to clipboard
JSON parser FATALs when it encounters a non JSON line in a file of JSON
This isn't really helpful behaviour as the rest of the stream is abandoned.
Could we either have a reader then ignores bad stuff or some switch to enable ignoring of dodgy records
We are assuming that this relates to JSON Lines format where each line contains a valid JSON object/array (except the bad lines).
We think that we should have both a JSONParser and a JSONLinesParser. The latter should should be configurable to control what happens to lines that are not valid JSON, e.g. FATAL, ERROR, WARN or ignore.