U h1@snddlmZddlmZmZmZddlmZddlm Z m Z dZ dZ dZ Gdd d e eZGd d d eZd S) )Path)AnyDictList) Embeddings) BaseModelFieldzVs zMOpenVINOEmbeddings.__init__..require_model_export..z/openvino_model.xmlz.xmlz.binT)ris_direxists model_infoas_posixZsiblingsreplace Exception)rrrZ model_dirZhf_apir%Z model_filesZ ov_model_pathrrr!require_model_exportEs0  z9OpenVINOEmbeddings.__init__..require_model_exportexportT) AutoTokenizerzQUnable to import transformers, please install with `pip install -U transformers`.)NN)super__init__Zoptimum.intel.openvinor ImportErrorZhuggingface_hubrstrrboolr Zfrom_pretrainedrr Z transformersr+r )selfrrer)r+ __class__rr!r-/s^#  zOpenVINOEmbeddings.__init__textrcCsdt|trttt|St|ds,dSt|dksFt|dtrNt|Stdd|DSdS)z Help function to get the length for the input text. Text can be either a list of ints (which means a single text as input), or a tuple of list of ints (representing several text inputs to the model). __len__rcSsg|] }t|qSr )lenrtr r r!r"sz3OpenVINOEmbeddings._text_length..N) isinstancedictr9nextitervalueshasattrintsumr1r6r r r! _text_length|s  zOpenVINOEmbeddings._text_lengthT) sentences batch_sizeshow_progress_barconvert_to_numpyconvert_to_tensor mean_poolingnormalize_embeddingsrc slz ddl}Wn,tk r8} ztd| W5d} ~ XYnXzddlm} Wn,tk rv} ztd| W5d} ~ XYnXz ddlWn,tk r} ztd| W5d} ~ XYnXtttdfdd } |rd }d } ttstd sgd } g| fd dD} fdd| D}| dt |d| dD]}||||}j j j dd}|jr~j|d d dd}nj|d|d dd}j f|}|r| ||d}n|ddddf}|rjjj|ddd}|r|}|q8fdd| | D|r@t r6nn|rZ|ddD| rhdS)aw Computes sentence embeddings. :param sentences: the sentences to embed. :param batch_size: the batch size used for the computation. :param show_progress_bar: Whether to output a progress bar. :param convert_to_numpy: Whether the output should be a list of numpy vectors. :param convert_to_tensor: Whether the output should be one large tensor. :param mean_pooling: Whether to pool returned vectors. :param normalize_embeddings: Whether to normalize returned vectors. :return: By default, a 2d numpy array with shape [num_inputs, output_dimension]. rNzCUnable to import numpy, please install with `pip install -U numpy`.)trangezAUnable to import tqdm, please install with `pip install -U tqdm`.zCUnable to import torch, please install with `pip install -U torch`.) model_outputattention_maskrcsD|d}|d|}||dj|dddS)Nrr8g& .>)min)Z unsqueezeexpandsizefloatrCclamp)rOrPZtoken_embeddingsZinput_mask_expanded)torchr r!run_mean_poolingsz3OpenVINOEmbeddings.encode..run_mean_poolingFr7Tcsg|]}| qSr )rE)rZsenr1r r!r"sz-OpenVINOEmbeddings.encode..csg|] }|qSr r ridx)rGr r!r"sZBatches)descdisabler8pt)padding truncationreturn_tensors max_length)r_rbr`rarP)pZdimcsg|] }|qSr r rZ)all_embeddingsr r!r"scSsg|] }|qSr )numpy)rZembr r r!r"s)rfr.ZtqdmrNrWrr<r/rAZargsortr9r requestinputsZget_partial_shapeZ is_dynamicr Z get_lengthnnZ functional normalizecpuextendstackZTensorZasarray)r1rGrHrIrJrKrLrMnpr2rNrXZinput_was_stringZlength_sorted_idxZsentences_sorted start_indexZsentences_batchlengthfeaturesZ out_features embeddingsr )rer1rGrWr!encodes         zOpenVINOEmbeddings.encodec@seZdZdZdS)zOpenVINOEmbeddings.ConfigZforbidN)__name__ __module__ __qualname__extrar r r r!ConfigsrxtextsrcCs4ttdd|}|j|fd|ji|j}|S)Compute doc embeddings using a HuggingFace transformer model. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. cSs |ddS)N  )r')xr r r!z4OpenVINOEmbeddings.embed_documents..rI)listmaprsrrtolistr1rzrrr r r!embed_documentss z"OpenVINOEmbeddings.embed_documentscCs||gdS)Compute query embeddings using a HuggingFace transformer model. Args: text: The text to embed. Returns: Embeddings for the text. r)rrDr r r! embed_querys zOpenVINOEmbeddings.embed_query) model_pathrcCs&|j|j||j|dS)NT)r ZhalfZsave_pretrainedr )r1rr r r! save_model s   zOpenVINOEmbeddings.save_model)rFFTFFT)rtrurv__doc__r__annotations__r/rr=rrrrr0r-rBrErsrxrrUrrr __classcell__r r r3r!r s>  M s r cspeZdZUdZeZeed<dZeed<e dfdd Z e ee e e dd d Z ee e d d d ZZS)OpenVINOBgeEmbeddingsaOpenVNO BGE embedding models. Bge Example: .. code-block:: python from langchain_community.embeddings import OpenVINOBgeEmbeddings model_name = "BAAI/bge-large-en-v1.5" model_kwargs = {'device': 'CPU'} encode_kwargs = {'normalize_embeddings': True} ov = OpenVINOBgeEmbeddings( model_name_or_path=model_name, model_kwargs=model_kwargs, encode_kwargs=encode_kwargs ) query_instructionembed_instructionrc s"tjf|d|jkrt|_dS)rz-zhN)r,r-r DEFAULT_QUERY_BGE_INSTRUCTION_ZHr)r1rr3r r!r-As zOpenVINOBgeEmbeddings.__init__rycs*fdd|D}j|fj}|S)r{csg|]}j|ddqS)r|r})rr'r:rYr r!r"Qsz9OpenVINOBgeEmbeddings.embed_documents..)rsrrrr rYr!rHs z%OpenVINOBgeEmbeddings.embed_documentsr5cCs*|dd}|j|j|f|j}|S)rr|r})r'rsrrr)r1r6Z embeddingr r r!rUs z!OpenVINOBgeEmbeddings.embed_query)rtrurvr DEFAULT_QUERY_BGE_INSTRUCTION_ENrr/rrrr-rrUrrrr r r3r!r*s    rN)pathlibrtypingrrrZlangchain_core.embeddingsrZlangchain_core.pydantic_v1rrZDEFAULT_QUERY_INSTRUCTIONrrr rr r r r!s