[FEATURE] Metadata filtering in Postgres

[haimco50]

I maybe missing something here but I realy tried hard to make it working w/o success - anyhow I can't make the postgress componnet working to filter the docs results by a given meta data info - it's basically ignoring my metadata filteeing - here is my test case setup : DB : 10 docs numbered with source numbered 1-10

Postgress comp - tried few variations of building the filter id tag but nothing works : - based on pgvector documentation it's supported - https://github.com/langchain-ai/langchain/issues/9726

Anyhow - my failed test case is runnning RAG flow with hard coded '4' within the source tag but getting other random documents each time. and not the expected "4" doc -

[HenryHengZJ]

Currently we still haven't added the capability to do Metadata filter for PG Vector DB. The Additional Configuration is the config used to connect to Postgres, not for filtering

[haimco50]

thanks @HenryHengZJ for confirming that it's not supported - saved me some time from keep struggling with this. Postgres DB is a very popular vector store and supporting metadata especially with a lot of files becomes a real necessity for any prod deployment so appreciate it if you prioritize this item - I am ready also to contribute here with some guidelines.

[haimco50]

btw, is it possible to add more columns the the current postegree table current columns are : id, pageContent, metadata, embedding ? if not I think this could be another great enhancement as it's realy needed for various use cases,

[SirLucian]

Please. Need this for supabase please 🥺

I may see what I can do to contribute

[Astriel]

Hey there, facing the same problem with embeddings on PGSQL. I'm using Flowise to be able to parse document, but each time I load a new one, it's always the first one which is loaded through PostGres. Everything was working well with Pinecone.

[HenryHengZJ]

here we go - https://github.com/FlowiseAI/Flowise/pull/2674

[HenryHengZJ]

Merged now 🎊

[haimco50]

This is great news - thanks much!!

On Wed, Jun 19, 2024 at 4:24 PM Henry Heng @.***> wrote:

Closed #2296 https://github.com/FlowiseAI/Flowise/issues/2296 as completed.

— Reply to this email directly, view it on GitHub https://github.com/FlowiseAI/Flowise/issues/2296#event-13216504757, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVXSN6CGXS423WOOYJJRTDTZIGBAHAVCNFSM6AAAAABHAQCQHOVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJTGIYTMNJQGQ3TKNY . You are receiving this because you authored the thread.Message ID: @.***>

[Astriel]

I've updated flowise and restarted docker, but seems I can't find the feature into the Postgres vector store ? Is there anything else to do ?

[mpurani]

@HenryHengZJ great news. when it will be updated on npm build.