U h!@s0ddlmZddlZddlmZmZmZmZmZddl m Z ddl m Z m Z ddlmZddlmZddlmZmZdd lmZmZmZdd lmZmZmZmZmZdd lm Z e!e"Z#d d dddZ$ddddddZ%ddddddZ&e ddddGdddeZ'e ddddGd ddee'Z(dS)!) annotationsN)AnyCallableDictListOptional) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM) Serializable)Field SecretStr)convert_to_secret_strget_from_dict_or_envpre_init)before_sleep_logretryretry_if_exception_typestop_after_attemptwait_exponential)enforce_stop_tokensintzCallable[[Any], Any]) max_retriesreturncCsVddl}t|drt|jjntt}d}d}tdt|td||d|t t t j dS) Nrerror T)Z multiplierminmax)reraisestopwaitrZ before_sleep) coherehasattrrrZ CohereError ExceptionrrrrloggerloggingWARNING)rr$Zretry_conditionsZ min_secondsZ max_secondsr*C/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/cohere.py_create_retry_decorators  r,Coherer)llmkwargsrc s,tj}|dddfdd }|f|S)*Use tenacity to retry the completion call.rr/rcsjjf|SN)clientgenerater/r.r*r+_completion_with_retry7sz5completion_with_retry.._completion_with_retryr,rr.r/Zretry_decoratorr7r*r6r+completion_with_retry3s r:c s,tj}|dddfdd }|f|S)r0rr1csjjf|IdHSr2) async_clientr4r5r6r*r+r7Bsz6acompletion_with_retry.._completion_with_retryr8r9r*r6r+acompletion_with_retry>s r<z0.0.30z1.0zlangchain_cohere.BaseCohere)ZsinceZremovalZalternative_importc@seZdZUdZded<ded<eddZded<d Zd ed <dZd ed <dZ ded<eddZ ded<dZ ded<e dddddZ dS) BaseCoherezBase class for Cohere models.rr3r;N)default Optional[str]modelg?float temperaturezOptional[SecretStr]cohere_api_keyOptional[List[str]]r"Fbool streamingZ langchainstr user_agentr)valuesrcCs~z ddl}Wntk r(tdYnRXtt|dd|d<|d}|j|d|d|d<|j|d|d|d <|S) z?Validate that api key and python package exists in environment.rNzTCould not import cohere python package. Please install it with `pip install cohere`.rCCOHERE_API_KEYrH)Zapi_key client_namer3r;)r$ ImportErrorrrZClientZget_secret_valueZ AsyncClient)clsrIr$rKr*r*r+validate_environmentbs&       zBaseCohere.validate_environment)__name__ __module__ __qualname____doc____annotations__r r@rBrCr"rFrHrrNr*r*r*r+r=Is     r=z0.1.14zlangchain_cohere.Coherec@seZdZUdZdZded<dZded<dZded<d Zd ed <d Z d ed <d Z ded<dZ ded<GdddZ e ddddZe ddddZe ddddZe ddddZd d!d"d#d$d%Zd!d dd&d'd(Zd0dd d)d!dd*d+d,Zd1dd d-d!dd*d.d/Zd S)2r-aCohere large language models. To use, you should have the ``cohere`` python package installed, and the environment variable ``COHERE_API_KEY`` set with your API key, or pass it as a named parameter to the constructor. Example: .. code-block:: python from langchain_community.llms import Cohere cohere = Cohere(model="gptd-instruct-tft", cohere_api_key="my-api-key") r max_tokensrkrpgrAfrequency_penaltypresence_penaltyNr?truncaterrc@seZdZdZdS)z Cohere.ConfigZforbidN)rOrPrQextrar*r*r*r+Configsr\zDict[str, Any])rcCs"|j|j|j|j|j|j|jdS)z2Get the default parameters for calling Cohere API.rUrBrVrWrXrYrZr]selfr*r*r+_default_paramsszCohere._default_paramszDict[str, str]cCsddiS)NrCrJr*r^r*r*r+ lc_secretsszCohere.lc_secretscCsd|ji|jS)zGet the identifying parameters.r@)r@r`r^r*r*r+_identifying_paramsszCohere._identifying_paramsrGcCsdS)zReturn type of llm.r$r*r^r*r*r+ _llm_typeszCohere._llm_typerDrdict)r"r/rcKsH|j}|jdk r"|dk r"tdn|jdk r8|j|d<n||d<||S)Nz2`stop` found in both the input and default params.stop_sequences)r`r" ValueError)r_r"r/paramsr*r*r+_invocation_paramss   zCohere._invocation_params)responser"rcCs|jdj}|rt||}|S)Nr)Z generationstextr)r_rir"rjr*r*r+_process_responses  zCohere._process_responsez"Optional[CallbackManagerForLLMRun])promptr" run_managerr/rcKs<|j|f|}t|f|j|d|}|d}|||S)ahCall out to Cohere's generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = cohere("Tell me a joke.") r@rlre)rhr:r@getrkr_rlr"rmr/rgri_stopr*r*r+_calls z Cohere._callz'Optional[AsyncCallbackManagerForLLMRun]csB|j|f|}t|f|j|d|IdH}|d}|||S)atAsync call out to Cohere's generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = await cohere("Tell me a joke.") rnNre)rhr<r@rorkrpr*r*r+_acalls  z Cohere._acall)NN)NN)rOrPrQrRrUrSrVrWrXrYrZrr\propertyr`rarbrcrhrkrrrsr*r*r*r+r-|s2           )) __future__rr(typingrrrrrZlangchain_core._api.deprecationrZlangchain_core.callbacksr r Z#langchain_core.language_models.llmsr Z langchain_core.load.serializabler Zlangchain_core.pydantic_v1r rZlangchain_core.utilsrrrZtenacityrrrrrZlangchain_community.llms.utilsr getLoggerrOr'r,r:r<r=r-r*r*r*r+s,        0