pypi-json-data icon indicating copy to clipboard operation
pypi-json-data copied to clipboard

SQLite DB with package name only

Open iloveitaly opened this issue 10 months ago • 4 comments

Thoughts on creating a "thinner" DB with package names only.

Would help solve searching locally for this extension: https://github.com/raycast/extensions/issues/16494

iloveitaly avatar Feb 15 '25 17:02 iloveitaly

We could definitely add that, but if you just want the package names then a gzip-compressed JSON file might be simpler?

However, adding a stripped down and smaller SQLite database feels like it should have more than just the package names. Excluding the package URLs for example, or some of the larger columns. This would have 1 row per package version

orf avatar Feb 18 '25 22:02 orf

More information would be great, this could make a much richer experience in the extension! Main issue is the size: 1.5GB is too much. Would hope the entire DB could be < 100mb or so. The more data that could fit into a much smaller size would be amazing!

iloveitaly avatar Feb 19 '25 00:02 iloveitaly

What extra information would you be looking for, specifically?

orf avatar Feb 19 '25 00:02 orf

The main goal would be providing a richer search experience. Right now, you can only search on words in a package title.

If we included:

  • Description
  • Keywords

We could enable full text search on these fields in SQLite for a richer search experience.

The version, homepage, etc information can be pulled using the pypi API so I'm not as worried about those. It's only the search experience that is impossible to replicate right now since there is no search API.

iloveitaly avatar Feb 19 '25 16:02 iloveitaly