framework
framework copied to clipboard
Retrieving Processed JSON Data from Input CSV After Validation
We integrated Frictionless for validating CSV files, and we are receiving validation responses as expected. However, we need to retrieve the original processed data in JSON format, parsed directly from the input CSV, along with the validation response.
Could you kindly confirm if there is a built-in method or API endpoint within Frictionless that allows us to obtain the parsed JSON data along with or after the validation process? If so, any guidance or documentation would be greatly appreciated.
the original processed data in JSON format
Sorry, I do not understand this. Can you please elaborate ? Do you mean the validation report in JSON format ?
If yes, then frictionless validate --json returns the report in JSON format.
Here’s the refined reply for your query:
Thank you for your response!
To clarify, we are successfully receiving the validation report in JSON format using the validate method. However, along with the validation report, we also need the actual data from the CSV file in a JSON-like format (e.g., rows parsed into dictionaries or similar structures).
We are aware of the extract method, which allows parsing CSV data into JSON. However, we would like to know if this data extraction can be done directly within the validate process, avoiding the need to handle the file separately for validation and data extraction.
Could you please confirm:
- If there’s a built-in feature in
validatethat supports this functionality? - If not, would you recommend combining
validateandextractprogrammatically to achieve this?
Any guidance or suggestions would be highly appreciated. Thank you!