[FEAT]: Enable the use of multiple DB types

[rieger-jared]

Describe the feature you want

TODO

Complimentary Material
TODO

• langchain
• open-webui

[rieger-jared]

@Davidyz I thought I'd create this issue as a reference for ideas and discussion, rather than having it spread over many PR etc. Would you mind assigning it to me if possible?

[Davidyz]

The current implementation utilises chromadb's logical operators in metadata to filter the retrieval results. This allows the users to exclude certain files when running a query. The langchain VectorStore class doesn't seem to offer this. We'd need to investigate some popular vector DBs and see if they work with these. We may end up having to write our own DB adapters if we need to transform the metadata to get filtering on other DBs.

[superbiche]

@Davidyz just watched a YT video from people I follow talking about https://github.com/unum-cloud/USearch . Honestly, I don't know anything about vector search, Chroma, FAISS, etc, but apparently USearch is worth having a look performance-wise