U h@spdZddlZddlmZddlmZmZmZmZddl m Z ddl m Z m Z dgZeeZGddde e ZdS) z-written under MIT Licence, Michael Feil 2023.N) getLogger)AnyDictListOptional) Embeddings) BaseModelroot_validatorInfinityEmbeddingsLocalc@seZdZUdZeed<dZeeed<dZe ed<dZ eed<d Z eed <d Z e ed <dZeed <GdddZedd deedddZddddZeddddZeeeeedddZeeeddd Zeeeeedd!d"Zeeedd#d$ZdS)%r aOptimized Infinity embedding models. https://github.com/michaelfeil/infinity This class deploys a local Infinity instance to embed text. The class requires async usage. Infinity is a class to interact with Embedding Models on https://github.com/michaelfeil/infinity Example: .. code-block:: python from langchain_community.embeddings import InfinityEmbeddingsLocal async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) modelNrevision batch_sizeautodeviceZtorchbackendT model_warmupenginec@seZdZdZdS)zInfinityEmbeddingsLocal.ConfigZforbidN)__name__ __module__ __qualname__extrarrQ/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/embeddings/infinity_local.pyConfig<srF)preZskip_on_failure)valuesreturncCsrzddlm}Wntk r,tdYnXtd|||d|d|d|d|d |d d |d <|S) z?Validate that api key and python package exists in environment.r)AsyncEmbeddingEnginezrPlease install the `pip install 'infinity_emb[optimum,torch]>=0.0.24'` package to use the InfinityEmbeddingsLocal.z*Using InfinityEmbeddingsLocal with kwargs r rr rrr)Zmodel_name_or_pathrr rrrr)Z infinity_embr ImportErrorloggerdebug)clsrrrrrvalidate_environment?s   z,InfinityEmbeddingsLocal.validate_environment)rcs|jIdHdS)aQstart the background worker. recommended usage is with the async with statement. async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) N)r __aenter__)selfrrrr$Ws z"InfinityEmbeddingsLocal.__aenter__)argsrcs|jj|IdHdS)zUstop the background worker, required to free references to the pytorch model.N)r __aexit__)r%r&rrrr'dsz!InfinityEmbeddingsLocal.__aexit__)textsrc sl|jjsRtd|4IdH|j|IdH\}}W5QIdHRXtdn|j|IdH\}}|S)zAsync call out to Infinity's embedding endpoint. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. zeStarting Infinity engine on the fly. This is not recommended.Please start the engine before using it.Nz$Stopped infinity engine after usage.)rZrunningr warningembed)r%r( embeddings_rrraembed_documentsis & z(InfinityEmbeddingsLocal.aembed_documents)textrcs||gIdH}|dS)zAsync call out to Infinity's embedding endpoint. Args: text: The text to embed. Returns: Embeddings for the text. Nr)r-)r%r.r+rrr aembed_querys z$InfinityEmbeddingsLocal.aembed_querycCstdt||S)z, This method is async only. zQThis method is async only. Please use the async version `await aembed_documents`.)r r)asynciorunr-)r%r(rrrembed_documentssz'InfinityEmbeddingsLocal.embed_documentscCstdt||S) zMThis method is async only. Please use the async version `await aembed_query`.)r r)r0r1r/)r%r.rrr embed_querysz#InfinityEmbeddingsLocal.embed_query)rrr__doc__str__annotations__r rrintrrrboolrrrr rr#r$r'rfloatr-r/r2r4rrrrr s"          )r5r0loggingrtypingrrrrZlangchain_core.embeddingsrZlangchain_core.pydantic_v1rr __all__rr r rrrrs