skshetry
skshetry
What do you suggest?
Can we introduce something like `strict` mode in schema, similar to `pydantic` to support non-nullable types? https://docs.pydantic.dev/latest/concepts/strict_mode/
https://github.com/jelmer/dulwich/issues/1203 has been fixed in the latest release (https://github.com/jelmer/dulwich/releases/tag/dulwich-0.23.0).
Related: https://github.com/fsspec/filesystem_spec/issues/1768
@rposborne, PTAL at https://github.com/iterative/PyDrive2/pull/364. PyDrive2 depends on `oauth2client` which requires an older version of `pyopenssl`, and the older version of `pyopenssl` is not compatible with newer version of `cryptography`. `oauth2client`...
> Is this expected? I'd think DVC could observe file mtimes and skip files quickly on repeat invocations, at a minimum. That's not expected. DVC does cache hashes based on...
Looks like you have ~290 import stages in your repository, which is instantiating S3FileSystem eagerly (one filesystem for each stage). That is 48s of the total runtime. Could you please...
Thanks for the profiling data. At a quick glance, nothing stands out (except of yaml parsing), everything just seems generally slower. Please make sure `ruamel-yaml-clib` is installed, as yaml parsing...
I have released a new version of [`dvc-s3==3.2.2`](https://github.com/iterative/dvc-s3/releases/tag/3.2.2).
> There's 145 `s3/tripdata/*.dvc` files (half of 290), each generated by `dvc import-url`. Not sure why each counts as 2, just noting. Right, DVC reads .dvc/dvc.yaml/dvc.lock files from your current...