create a searchable vector DB of all elements vs just chunking

[filip-michalsky]

It's sometimes hard to find the right elements when navigating the website in chunks - things can reload etc as scroll down.

What if we have a hashing/embedding algorithm for each URL where we store a very sparse/compact representation of an element. Hopefully, we can then query / RAG relevant candidates beyond the chunking window, which would allow us to "see" beyond the viewport and potentially find more things...