json2nd
json2nd copied to clipboard
Excellent tool. Any way to see the keys available on a large json?
This tool is amazing. I was having trouble ingesting json data using DuckDB because the object sizes where too large. With this I can just pick the large arrays apart into separate objects and DuckDB ingests without trouble! (.jsonl are much more efficient for duckdb ingestion because instead of whole arrays in memory you instantiate individual objects).
If you or anyone could recommend a tool to see the top-level keys of a json file (or the keys available under a given path) that would make my life even better. If you know that tool please recommend :) I'm dealing with ~100+GB files and the only approach I can think of is slow Python ijson module. Thankfully most follow a schema so I usually know the keys.