langchain_dart icon indicating copy to clipboard operation
langchain_dart copied to clipboard

Published 20 hours ago • verified publisher icon davidmigloz

Feat/sqlite vec vector store

Open Heinrich-vanNieuwenhuizen opened this issue 1 year ago • 4 comments
trafficstars

Feature #516

Description

This pull request refactors and enhances the SQLite vector store implementation, transitioning from SQLiteVSS to SQLiteVec. The changes improve compatibility with Langchain 0.3 and introduce various optimizations and structural improvements.

Dependencies

  • Updated pubspec.yaml to reflect new dependencies and omissions.
  • Added a tool to download SQLite3 binaries, improving cross-platform compatibility.

Changes

  • Refactored SQLiteVSS to SQLiteVec, including file renames and code adjustments.
  • Updated database connection handling for native, web, and unsupported platforms.
  • Improved error handling and debugging utilities.
  • Restructured the vector store implementation for better maintainability and performance.

Testing

  • Updated and renamed test files to reflect the transition from SQLiteVSS to SQLiteVec.
  • Ensured test coverage for the refactored implementation.

Code Quality

  • Applied Dart formatting to ensure consistent code style.
  • Implemented Dart fixes to address potential issues and improve code quality.

Additional Notes

  • This PR includes changes across multiple commits, focusing on refactoring, compatibility updates, and structural improvements.
  • The transition to SQLiteVec aims to provide a more robust and efficient vector store implementation within the Langchain community package.

Heinrich-vanNieuwenhuizen avatar Oct 10 '24 13:10 Heinrich-vanNieuwenhuizen

I started with the review 🙂 I need to familiarize a bit with sqlite3 and drift first.

davidmigloz avatar Oct 17 '24 13:10 davidmigloz

I started with the review 🙂 I need to familiarize a bit with sqlite3 and drift first.

No issues, let me know if you want to do a google meet up if you want me to take you through it.

Heinrich-vanNieuwenhuizen avatar Oct 18 '24 02:10 Heinrich-vanNieuwenhuizen

I've been sort of mental capacity the last few days. I'll resume the review tomorrow. I'll let you know if we need to jump in on a call, but thanks for the offer.

davidmigloz avatar Oct 21 '24 21:10 davidmigloz

I've been sort of mental capacity the last few days. I'll resume the review tomorrow. I'll let you know if we need to jump in on a call, but thanks for the offer.

anytime

Heinrich-vanNieuwenhuizen avatar Oct 22 '24 12:10 Heinrich-vanNieuwenhuizen