-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Agnostic local inference #799
base: dev
Are you sure you want to change the base?
Conversation
✅ Deploy Preview for poetic-froyo-8baba7 ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
4f7b120
to
30e4da4
Compare
qdrant_client/qdrant_fastembed.py
Outdated
model_name = query.model | ||
if model_name is None: | ||
raise ValueError( | ||
"`query_points` requires explicit model name specification for `Document`" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't know if this method will only be called from query_points
qdrant_client/qdrant_fastembed.py
Outdated
|
||
def _embed_document( | ||
self, document: models.Document, is_query: bool = False | ||
) -> Union[List[float], models.SparseVector]: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Late interaction can also return List[List[float]]
I propose to define a type alias for this, otherwise too verbose
6fb9d64
to
15981e7
Compare
WIP: