dlt
dlt copied to clipboard
dlt-hub
Add LanceDB custom destination example code
Description
Showcases integration of LanceDB, an open-source vector database, as a custom destination within the dlt ecosystem. It includes a Python script that demonstrates how to set up LanceDB as a custom destination and populate the vector store with data from spotify api.
Related Issues
- Resolves #1322
Deploy Preview for dlt-hub-docs canceled.
| Name | Link |
|---|---|
| Latest commit | 6655f5613a47fe1141ebd63e5ff698ad82c6461a |
| Latest deploy log | https://app.netlify.com/sites/dlt-hub-docs/deploys/667973f722ff6e000758f214 |
![netlify[bot] avatar](https://avatars.githubusercontent.com/in/13473?v=4 "Published by a pub.dev verified publisher"){kind=small}
It's a pretty cool example! But why are we not using our rest client? This will make the code much shorter and also showcase some of our other features. And we need to be able to run this on CI, so we need to have somebodies spotify login, maybe a free account would do for this?
@rahuljo if you could help me with this:
- set up cohere account
- add the secret (see the code for the key) to google vault (ping me if you need help)
- rerun the docs tests (that is failing) and then we merge it!
