Use text embeddings for more general searching?

Have a suggestion for "Everything"? Please post it here.
Invariant
Posts: 6
Joined: Wed Apr 09, 2025 3:01 am

Use text embeddings for more general searching?

Post by Invariant »

Might be an interesting feature and would likely be a relatively simple feature to add. E.g., the use of local or remote embedding evaluation. E.g.,llama or Ollama.

I'm mainly thinking of it working on filenames and ideally books and text documents like pdfs, epubs, and txt. Something that would actually be meaningful to search with and even to get book information online from the filename.

E.g., a setting where one could add folders which can be indexed in this way and then a special search token to use. To search by embedding.

"Text embeddings can be used to search by converting words, sentences, or documents into high-dimensional numerical vectors that capture their meanings. This allows a search system to measure the similarity between a query and documents, enabling it to return results based on semantic meaning rather than just exact".