framework
framework copied to clipboard
Data management framework for Python that provides functionality to describe, extract, validate, and transform tabular data
- fixes #1633 - fixes #1635 --- This PR fixes unexpected `missing-label` error in validation report which occurs when validating tabular data in this specific case (#1635): The data contains...
# Overview Adding `--parallel` to `frictionless validate` breaks validation and fails. I could really use this flag because multiple files in this dataset are ≥ 2GB, some approaching 7GB. #...
I have found an issue with frictionless with Python 3.12 that doesn't occur with Python 3.11. Here is the trace: ``` ../../../.local/share/hatch/env/virtual/hdx-python-utilities/uS5tbIcO/test.py3.12/lib/python3.12/site-packages/frictionless/formats/excel/parsers/xlsx.py:67: in read_loader if not target.delete: _ _ _...
- fixes #1596 Since it was impossible to load a Package stored on s3 this adds an adapter to the AWS Plugin that previously only had a loader. It would...
We have a lot of workflows that involve curating data in pandas and then as a final step validating those data against a target schema. In general this works well,...
# Summary - fixes #1622 ## Problem statement The `Resource` class is also a [Context Manager](https://docs.python.org/3/reference/datamodel.html#context-managers). That is, it implements the `__enter()__` and `__exit()__` methods to allow the use of...
# Overview After installing [datadog's guarddog to scan pypi packages](https://github.com/DataDog/guarddog), guarddog finds 1 "potentially malicious indicators". FYI, "[GuardDog is a CLI tool to Identify malicious PyPI and npm packages](https://github.com/DataDog/guarddog)" or...
# Overview *Edit: In my case, I only tried foreign key checks, but as @fjuniorr noted below, `--skip-errors` appears to be broken for all errors when checking a package.* When...
Unable to open or describe parquet formatted files containing blank values. I've tied passing the missing values as '' as well. Both CLI and Python generate the same error. The...
## Overview In the of migration from v4 to v5 of frictionless-py in validata.fr, we experienced an unexpected `missing-label` error when validating a tabular data with `header_case=False` dialect option and...