U h&8@sddlZddlZddlmZddlmZmZmZmZm Z m Z m Z ddl Z ddl Z ddlmZmZddlmZddlmZmZddlmZmZddlmZdd lmZGd d d e ZGd d d eZdS)N)ThreadPoolExecutor)AnyDictListMappingOptionalSequence TypedDict)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)BaseLLM) Generation LLMResult)Fieldroot_validatorget_from_dict_or_env)enforce_stop_tokensc@seZdZUdZeed<dS) TrainResultz Train result.lossN)__name__ __module__ __qualname____doc__float__annotations__rrH/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/gradient_ai.pyrs rc@seZdZUdZedddZeed<dZe eed<dZ e eed<dZ e e ed <d Z eed <dZe ejed <Gd ddZeddeedddZedddeedddZeeeefdddZeedddZeeeeefeeefdddZeeeefeeefd d!d"Zd1ee eee eeed#d$d%Z d2ee eee e!eed#d&d'Z"d3eee eee eee#d(d)d*Z$d4eee eee e!ee#d(d+d,Z%eeee&dd-d.Z'eeee&dd/d0Z(dS)5 GradientLLMaGradient.ai LLM Endpoints. GradientLLM is a class to interact with LLMs on gradient.ai To use, set the environment variable ``GRADIENT_ACCESS_TOKEN`` with your API token and ``GRADIENT_WORKSPACE_ID`` for your gradient workspace, or alternatively provide them as keywords to the constructor of this class. Example: .. code-block:: python from langchain_community.llms import GradientLLM GradientLLM( model="99148c6d-c2a0-4fbe-a4a7-e7c05bdb8a09_base_ml_model", model_kwargs={ "max_generated_token_count": 128, "temperature": 0.75, "top_p": 0.95, "top_k": 20, "stop": [], }, gradient_workspace_id="12345614fc0_workspace", gradient_access_token="gradientai-access_token", ) model)aliasZ min_lengthmodel_idNgradient_workspace_idgradient_access_token model_kwargszhttps://api.gradient.ai/apigradient_api_url aiosessionc@seZdZdZdZdS)zGradientLLM.ConfigTZforbidN)rrrZallow_population_by_field_nameextrarrrrConfigLsr)T)pre)valuesreturncCs4t|dd|d<t|dd|d<t|dd|d<|S)z?Validate that api key and python package exists in environment.r$ZGRADIENT_ACCESS_TOKENr#ZGRADIENT_WORKSPACE_IDr&ZGRADIENT_API_URLr)clsr+rrrvalidate_environmentPs z GradientLLM.validate_environmentF)r*Zskip_on_failurecCsz ddl}Wn0tk r*tdYntk r<YnX|ddksZt|ddkrbtd|ddks~t|ddkrtd |d r|d }d|d d krd ksntdd|dd krd ksntdd|dd krtdd|dd krtd|S)zPost init validation.rNzdDeprecationWarning: `GradientLLM` will use `pip install gradientai` in future releases of langchain.r$ z0env variable `GRADIENT_ACCESS_TOKEN` must be setr#z0env variable `GRADIENT_WORKSPACE_ID` must be setr% temperatureg?z-`temperature` must be in the range [0.0, 1.0]top_pz'`top_p` must be in the range [0.0, 1.0]top_kz`top_k` must be positivemax_generated_token_countz,`max_generated_token_count` must be positive) gradientai ImportErrorloggingwarning Exceptionlen ValueErrorget)r-r+r6kwrrr post_init`s:    zGradientLLM.post_init)r,cCs|jpi}d|jid|iS)zGet the identifying parameters.r&r%)r%r&)self _model_kwargsrrr_identifying_paramss zGradientLLM._identifying_paramscCsdS)zReturn type of llm.Zgradientr)r@rrr _llm_typeszGradientLLM._llm_type)inputskwargsr,c Cs|jpi}||}|dd}t|jd|jdd|j|jdddt|dkrftdd |Dntd d t||Dd d S) Build the kwargs for the Post request, used by sync Args: prompt (str): prompt used in query kwargs (dict): model kwargs in payload Returns: Dict[str, Union[str,dict]]: _description_ multipliersN/models/z /fine-tuneBearer application/json authorizationzx-gradient-workspace-idacceptz content-typecss|]}d|iVqdS)rDNr).0inputrrr sz=GradientLLM._kwargs_post_fine_tune_request..css |]\}}|d|idVqdS) multiplier)rDZfineTuningParametersNr)rNrOrQrrrrPs )Zsamplesurlheadersjson) r%r=dictr&r"r$r#tuplezip)r@rDrErA_paramsrGrrr_kwargs_post_fine_tune_requests(    z*GradientLLM._kwargs_post_fine_tune_request)promptrEr,c Cst|jpi}||}t|jd|jdd|j|jdddt||dd|dd|d d|d dd d S) rFrHz /completerIrJrKr5Nr1r4r3)queryZmaxGeneratedTokenCountr1ZtopKZtopPrR)r%rVr&r"r$r#r=)r@r[rErArYrrr_kwargs_post_requests"      z GradientLLM._kwargs_post_request)r[stop run_managerrEr,c Ksz:tjf|||}|jdkr8td|jd|jWn4tjjk rn}ztd|W5d}~XYnX|d}|dk rt ||}|S)aCall to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. 5Gradient returned an unexpected response with status : 2RequestException while calling Gradient Endpoint: NgeneratedOutput) requestspostr] status_coder:text exceptionsRequestExceptionrUr)r@r[r^r_rEresponseerhrrr_calls    zGradientLLM._callc s |jst4IdHj}|jf|j||d4IdH:}|jdkrZtd|jd|j|IdHd}W5QIdHRXW5QIdHRXnf|jjf|j||d4IdH:}|jdkrtd|jd|j|IdHd}W5QIdHRX|dk rt ||}|S)aAsync Call to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. N)r[rEr`rarbrd) r'aiohttp ClientSessionrfr]statusr:rhrUr)r@r[r^r_rEsessionrkrhrrr_acalls.  4  "  zGradientLLM._acall)promptsr^r_rEr,c srtttdfdd }t|dkr:tt||}n.ttdt|}t|||}W5QRXt|dS)*Run the LLM on the given prompt and input.)r[r,cs tjf|ddgS)N)r[r^r_rh)r rm)r[rEr_r@r^rr_inner_generate>sz.GradientLLM._generate.._inner_generater2 generations) strrr r;listmaprminr)r@rsr^r_rErwrzprrvr _generate4s  zGradientLLM._generatecsDg}tfdd|DD]}|t|dgq"t|dS)rtc3s(|] }j|fdgVqdS))r^r_N)rr)rNr[rvrrrPXsz)GradientLLM._agenerate..rury)asyncioZgatherappendr r)r@rsr^r_rErzZ generationrrvr _agenerateOs  zGradientLLM._ageneratec Ksz:tjf|||}|jdkr8td|jd|jWn4tjjk rn}ztd|W5d}~XYnX|}|d|d}t |dS)Nr`rarbrcsumLossnumberOfTrainableTokensr) rerfrZrgr:rhrirjrUr)r@rDrErkrl response_jsonrrrrtrain_unsupervised_s   zGradientLLM.train_unsupervisedc s|jst4IdHt}|jf|||4IdHF}|jdkrXtd|jd|j|IdH}|d|d}W5QIdHRXW5QIdHRXnp|jjf|||4IdHF}|jdkrtd|jd|j|IdH}|d|d}W5QIdHRXt |dS)Nr`rarbrrr) r'rnrorfrZrpr:rhrUr)r@rDrErqrkrrrrratrain_unsupervisedts6  $  zGradientLLM.atrain_unsupervised)NN)NN)NN)NN))rrrrrr"r{rr#rr$r%rVr&r'rnror)rrr.r?propertyrrrBrCrrZr]rr rmr rrrrrrrrrrrrrs   *  .  #  %  /     r)rr8concurrent.futuresrtypingrrrrrrr rnreZlangchain_core.callbacksr r Z#langchain_core.language_models.llmsr Zlangchain_core.outputsr rZlangchain_core.pydantic_v1rrZlangchain_core.utilsrZlangchain_community.llms.utilsrrrrrrrs $