U h@sdZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z ddlmZddlmZmZdd lmZmZdd lmZeeZe d d d dGdddeZdS)z,Wrapper around Together AI's Completion API.N)AnyDictListOptional) ClientSession) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM) SecretStrroot_validatorconvert_to_secret_strget_from_dict_or_env)Requestsz0.0.12z1.0zlangchain_together.Together)ZsinceZremovalZalternative_importc@sLeZdZUdZdZeed<eed<eed<dZe e ed<dZ e e ed<dZ e e ed <dZe e ed <dZe e ed <dZe e ed <Gd ddZeddeedddZeedddZeedddZeedddZeeeefdddZd#ee eee eeeddd Zd$ee eee e eedd!d"Z!dS)%TogetheraLLLM models from `Together`. To use, you'll need an API key which you can find here: https://api.together.xyz/settings/api-keys. This can be passed in as init param ``together_api_key`` or set as environment variable ``TOGETHER_API_KEY``. Together AI API reference: https://docs.together.ai/reference/inference z"https://api.together.xyz/inferencebase_urltogether_api_keymodelN temperaturetop_ptop_k max_tokensrepetition_penaltylogprobsc@seZdZdZdS)zTogether.ConfigZforbidN)__name__ __module__ __qualname__extrarrE/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/together.pyConfigEsr!T)pre)valuesreturncCstt|dd|d<|S)z,Validate that api key exists in environment.rZTOGETHER_API_KEYr )clsr#rrr validate_environmentHs zTogether.validate_environment)r$cCsdS)zReturn type of model.Ztogetherrselfrrr _llm_typePszTogether._llm_type)outputr$cCs|ddddS)Nr*choicesrtextr)r(r*rrr _format_outputUszTogether._format_outputcCsddlm}d|S)Nr __version__z langchain/)Zlangchain_communityr/r.rrr get_user_agentXs zTogether.get_user_agentcCs|j|j|j|j|j|jdS)Nrrrrrrr1r'rrr default_params^szTogether.default_params)promptstop run_managerkwargsr$c Ksd|jdd}|r.t|dkr.|dn|}|j||d|}dd|D}t|d }|j|j|d } | jd krt d | jn>| jd krt d| j n"| jdkrt d| jd| j | } | ddkr| dd} t | || } | S)zCall out to Together's text generation endpoint. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model.. Bearer application/json Authorizationz Content-Typerr3r4cSsi|]\}}|dk r||qSNr.0kvrrr sz"Together._call..)headers)urldataTogether Server: Error &Together received an invalid payload: 5Together returned an unexpected response with status : statusfinishederrorUndefined Error)rget_secret_valuelenr2itemsrpostr status_code Exception ValueErrorr,jsongetr-) r(r3r4r5r6rC stop_to_usepayloadrequestresponserEerr_msgr*rrr _callis6      zTogether._callc s`d|jdd}|r.t|dkr.|dn|}|j||d|}dd|D}t4Id H}|j|j||d 4Id H} | jd krt d | jn>| jd krt d| j n"| jdkrt d| jd| j | Id H} | ddkr| dd} t | || } | W5QId HRW5QId HRSQId HRXW5QId HRXd S)zCall Together model to get predictions based on the prompt. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. r7r8r9r;rr<cSsi|]\}}|dk r||qSr=rr>rrr rBsz#Together._acall..N)rXrCrFrGrHrIrJrKrLrMrNrOrP)rrQrRr2rSrrTrrMrVrWr,rXrYr-) r(r3r4r5r6rCrZr[sessionr]Z response_jsonr^r*rrr _acallsD      zTogether._acall)NN)NN)"rrr__doc__rstr__annotations__r rrfloatrrintrrrr!r rr&propertyr)dictr- staticmethodr0rr2rr r_rrarrrr rsL     7 r)rbloggingtypingrrrrZaiohttprZlangchain_core._api.deprecationrZlangchain_core.callbacksrr Z#langchain_core.language_models.llmsr Zlangchain_core.pydantic_v1r r Zlangchain_core.utilsrrZ&langchain_community.utilities.requestsr getLoggerrloggerrrrrr s