U h)`@sJdZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z ddddd d d d d d d d d dddd d d d d d ddddddd d d d d d dddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddd_Z d(eeed d!d"Zd)eeeed#d$d%ZGd&d'd'eZdS)*z(Callback Handler that prints to std out.N)AnyDictList)BaseCallbackHandler) AIMessage)ChatGeneration LLMResultga2U0*#?ga2U0*C?g{Gzt?g{Gzd?gQ?g{Gz?gQ?gQ?gQ?g~jtX?gMb@?gMbP?g~jth?gMb`?gMbp?g-C6:?g{Gz?g-C6Z?g~jt?ga2U0*3?g~jtx?ga2U0*S?ga2U0*c?)_z gpt-4o-minizgpt-4o-mini-2024-07-18zgpt-4o-mini-completionz!gpt-4o-mini-2024-07-18-completionzgpt-4ozgpt-4o-2024-05-13zgpt-4o-2024-08-06zgpt-4o-completionzgpt-4o-2024-05-13-completionzgpt-4o-2024-08-06-completiongpt-4z gpt-4-0314z gpt-4-0613z gpt-4-32kzgpt-4-32k-0314zgpt-4-32k-0613zgpt-4-vision-previewzgpt-4-1106-previewzgpt-4-0125-previewzgpt-4-turbo-previewz gpt-4-turbozgpt-4-turbo-2024-04-09zgpt-4-completionzgpt-4-0314-completionzgpt-4-0613-completionzgpt-4-32k-completionzgpt-4-32k-0314-completionzgpt-4-32k-0613-completionzgpt-4-vision-preview-completionzgpt-4-1106-preview-completionzgpt-4-0125-preview-completionzgpt-4-turbo-preview-completionzgpt-4-turbo-completionz!gpt-4-turbo-2024-04-09-completionz gpt-3.5-turbozgpt-3.5-turbo-0125zgpt-3.5-turbo-0301zgpt-3.5-turbo-0613zgpt-3.5-turbo-1106zgpt-3.5-turbo-instructzgpt-3.5-turbo-16kzgpt-3.5-turbo-16k-0613zgpt-3.5-turbo-completionzgpt-3.5-turbo-0125-completionzgpt-3.5-turbo-0301-completionzgpt-3.5-turbo-0613-completionzgpt-3.5-turbo-1106-completionz!gpt-3.5-turbo-instruct-completionzgpt-3.5-turbo-16k-completionz!gpt-3.5-turbo-16k-0613-completionz gpt-35-turbozgpt-35-turbo-0125zgpt-35-turbo-0301zgpt-35-turbo-0613zgpt-35-turbo-instructzgpt-35-turbo-16kzgpt-35-turbo-16k-0613zgpt-35-turbo-completionzgpt-35-turbo-0125-completionzgpt-35-turbo-0301-completionzgpt-35-turbo-0613-completionz gpt-35-turbo-instruct-completionzgpt-35-turbo-16k-completionz gpt-35-turbo-16k-0613-completionz text-ada-001Zadaztext-babbage-001Zbabbageztext-curie-001Zcurieztext-davinci-003ztext-davinci-002zcode-davinci-002zbabbage-002-finetunedzdavinci-002-finetunedzgpt-3.5-turbo-0613-finetunedzgpt-3.5-turbo-1106-finetunedzgpt-3.5-turbo-0125-finetunedz gpt-4o-mini-2024-07-18-finetunedz babbage-002-finetuned-completionz davinci-002-finetuned-completionz'gpt-3.5-turbo-0613-finetuned-completionz'gpt-3.5-turbo-1106-finetuned-completionz'gpt-3.5-turbo-0125-finetuned-completionz+gpt-4o-mini-2024-07-18-finetuned-completionzbabbage-002-azure-finetunedzdavinci-002-azure-finetunedz!gpt-35-turbo-0613-azure-finetunedz&babbage-002-azure-finetuned-completionz&davinci-002-azure-finetuned-completionz,gpt-35-turbo-0613-azure-finetuned-completionzada-finetuned-legacyzbabbage-finetuned-legacyzcurie-finetuned-legacyzdavinci-finetuned-legacyF) model_name is_completionreturncCs|}d|kr"|ddd}d|kr<|ddd}d|krV|ddd }|r|d s|d s|d sd |krd|kr|dS|SdS)a% Standardize the model name to a format that can be used in the OpenAI API. Args: model_name: Model name to standardize. is_completion: Whether the model is used for completion or not. Defaults to False. Returns: Standardized model name. z.ft-rz-azure-finetunedz:ft-:z-finetuned-legacyzft:z -finetunedr zgpt-3.5zgpt-35Z finetunedlegacyz -completionN)lowersplit startswith)r r rM/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/callbacks/openai_info.pystandardize_model_names(r)r num_tokensr r cCsBt||d}|tkr2td|ddtt||dS)a& Get the cost in USD for a given model and number of tokens. Args: model_name: Name of the model num_tokens: Number of tokens. is_completion: Whether the model is used for completion or not. Defaults to False. Returns: Cost in USD. r zUnknown model: z=. Please provide a valid OpenAI model name.Known models are: z, i)rMODEL_COST_PER_1K_TOKENS ValueErrorjoinkeys)r rr rrrget_openai_token_cost_for_models   rcseZdZUdZdZeed<dZeed<dZeed<dZ eed<dZ e ed<d d fd d Z e d d dZeed ddZee efee ed dddZe ed dddZeed dddZdd ddZeddddZZS)OpenAICallbackHandlerz)Callback Handler that tracks OpenAI info.r total_tokens prompt_tokenscompletion_tokenssuccessful_requestsg total_costN)r cstt|_dS)N)super__init__ threadingLock_lockself __class__rrr$s zOpenAICallbackHandler.__init__c Cs,d|jd|jd|jd|jd|j S)Nz Tokens Used: z Prompt Tokens: z Completion Tokens: z Successful Requests: z Total Cost (USD): $)rrr r!r"r(rrr__repr__s*zOpenAICallbackHandler.__repr__cCsdS)z;Whether to call verbose callbacks even if verbose is False.Trr(rrralways_verbosesz$OpenAICallbackHandler.always_verbose) serializedpromptskwargsr cKsdS)zPrint out the prompts.Nr)r)r.r/r0rrr on_llm_startsz"OpenAICallbackHandler.on_llm_start)tokenr0r cKsdS)zPrint out the token.Nr)r)r2r0rrron_llm_new_tokensz&OpenAICallbackHandler.on_llm_new_token)responser0r c Ksz|jdd}Wntk r*d}YnXt|trz*|j}t|trV|j}|j}nd}d}Wqtk r|d}d}YqXnd}d}|rd|di}|d}|d} |pi d} rt | } n"|j dkrd} nt |j dd} nr|j dkrdSd|j kr&|j |j d 7_ W5QRXdS|j d}| d d}| d d} t |j dd} | tkr~t| |d d } t| | } nd} d} |j X|j| | 7_|j| dd7_|j| 7_|j|7_|j d 7_ W5QRXdS)zCollect token usage.rNrZ output_tokensZ input_tokensr token_usagerr rTr)Z generations IndexError isinstancermessagerusage_metadataresponse_metadataAttributeErrorgetrZ llm_outputr'r!rrr"rrr )r)r4r0Z generationr9r:r;r6r rZresponse_model_namer Zcompletion_costZ prompt_costrrr on_llm_endsn                z OpenAICallbackHandler.on_llm_endcCs|S)z&Return a copy of the callback handler.rr(rrr__copy__$szOpenAICallbackHandler.__copy__)memor cCs|S)z+Return a deep copy of the callback handler.r)r)r@rrr __deepcopy__(sz"OpenAICallbackHandler.__deepcopy__)__name__ __module__ __qualname____doc__rint__annotations__rr r!r"floatr$strr,propertyboolr-rrrr1r3rr>r?rA __classcell__rrr*rrs&         Dr)F)F)rEr%typingrrrZlangchain_core.callbacksrZlangchain_core.messagesrZlangchain_core.outputsrrrrIrKrrFrHrrrrrrs  y #