Hugo van Kemenade

Google BigQuery gives 1 TB free quota per month. Here's some data on past runs. The gaps indicate when switching to fetch data for more projects.  The 5k growth...

I've started the 90-day, $300 (€277.46) free trial to get things back on track and fetched the July data: ```sh pypinfo -v --json --indent 0 --limit 8000 -sd 2024-07-02 -ed...

Here's a couple of pypinfo commands, limiting to just the top 10 and 1 day, otherwise identical except for the `--all` flag. `--all` means "Show downloads by all installers, not...

Next, let's see how number of projects affects the cost. (This data fetched yesterday, 2024-11-09.) # Days = 1, limit = 1000...8000 Let's begin checking just one day for different...

To repeat with the limit increasing by powers of ten, up to 1,000,000, getting data for all 531,022 on PyPI. limit | projects count | estimated_cost | bytes_billed | bytes_processed...

Omitting the `LIMIT` is the same as fetching all, effectively the same as `LIMIT 1000000`, and the same cost (0.20): ```sql SELECT file.project as project, COUNT(*) as download_count, FROM `bigquery-public-data.pypi.file_downloads`...

I've switched to fetching data for all installers: https://github.com/hugovk/top-pypi-packages/pull/39 And written this up at https://dev.to/hugovk/a-surprising-thing-about-pypis-bigquery-data-2g9o

> Thanks. However, I don't plan to merge this without free threading handled as well, as that would just make more work for me later on to try to figure...

Yep, not supported by tox yet, waiting for virtualenv support first: * https://github.com/tox-dev/tox/issues/3314 * https://github.com/tox-dev/tox/issues/3391 - which also suggests "[`--discover`](https://tox.wiki/en/4.21.2/cli_interface.html#tox-run---discover) in the meantime to force it"

Still reproducible with the `uv` command. And adding a version print: ```python import sys from markupsafe import escape print(sys.version) print(escape("828")) ``` ```pytb ❯ uv run --python /Library/Frameworks/Python.framework/Versions/3.14/bin/python3 --with markupsafe==3.0.2 1.py...