U hm@shddlmZmZmZmZmZddlmZddlm Z ddl m Z ddl m Z mZmZGddde ZdS) )AnyDictListMappingOptional)CallbackManagerForLLMRun)LLM) SecretStr)convert_to_secret_strget_from_dict_or_envpre_initc@sbeZdZUdZeed<dZeed<dZe ed<dZ eed<d Z e ed <d Z eed <dZe ed <dZe ed<dZe ed<gZeeed<dZe ed<dZeed<dZe ed<dZeed<dZeed<dZeeed<GdddZeeedddZe e!eefd d!d"Z"e e!eefd d#d$Z#e ed d%d&Z$d*eeeeee%eed'd(d)Z&dS)+NLPCloudaaNLPCloud large language models. To use, you should have the ``nlpcloud`` python package installed, and the environment variable ``NLPCLOUD_API_KEY`` set with your API key. Example: .. code-block:: python from langchain_community.llms import NLPCloud nlpcloud = NLPCloud(model="finetuned-gpt-neox-20b") clientzfinetuned-gpt-neox-20b model_nameTgpuenlanggffffff? temperature max_lengthlength_no_input remove_inputremove_end_sequence bad_wordsg?top_p2top_krepetition_penalty num_beamsnum_return_sequencesNnlpcloud_api_keyc@seZdZdZdS)zNLPCloud.ConfigZforbidN)__name__ __module__ __qualname__extrar&r&E/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/nlpcloud.pyConfig6sr()valuesreturncCsltt|dd|d<z6ddl}|j|d|d|d|dd|d <Wntk rftd YnX|S) z?Validate that api key and python package exists in environment.r!ZNLPCLOUD_API_KEYrNrrr)rrrzXCould not import nlpcloud python package. Please install it with `pip install nlpcloud`.)r r nlpcloudZClientZget_secret_value ImportError)clsr)r+r&r&r'validate_environment9s    zNLPCloud.validate_environment)r*c Cs2|j|j|j|j|j|j|j|j|j|j |j d S)z4Get the default parameters for calling NLPCloud API. rrrrrrrrrrr r/selfr&r&r'_default_paramsOszNLPCloud._default_paramscCs d|jid|jid|ji|jS)zGet the identifying parameters.rrr)rrrr2r0r&r&r'_identifying_params`s zNLPCloud._identifying_paramscCsdS)zReturn type of llm.r+r&r0r&r&r' _llm_typejszNLPCloud._llm_type)promptstop run_managerkwargsr*cKsb|rt|dkrtdn|r4t|dkr4|d}nd}|j|}|jj|fd|i|}|dS)alCall out to NLPCloud's create endpoint. Args: prompt: The prompt to pass into the model. stop: Not supported by this interface (pass in init method) Returns: The string generated by the model. Example: .. code-block:: python response = nlpcloud("Tell me a joke.") rzXNLPCloud only supports a single stop sequence per generation.Pass in a list of length 1.rN end_sequenceZgenerated_text)len ValueErrorr2rZ generation)r1r5r6r7r8r9paramsresponser&r&r'_callos  zNLPCloud._call)NN)'r"r#r$__doc__r__annotations__rstrrboolrrfloatrintrrrrrrrrrr r!rr r(r rr.propertyrr2r3r4rr>r&r&r&r'r sF                 r N)typingrrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZlangchain_core.pydantic_v1r Zlangchain_core.utilsr r r r r&r&r&r's