iN/ zddlZddlZddlmZmZmZmZmZddlm Z ddl m Z m Z m Z mZddlmZddlZe eZdZdZeeezZd Zed fd ed ed edefdZde edefdZde ede efdZde edefdZde ede efdZdede e eeffdZdZ dedefdZ! ddede eeegeffdZ"y)N) ToolMessage BaseMessage HumanMessage AIMessage SystemMessage) get_logger)ListOptionalTupleCallable)get_llmigffffff?i'text max_chars query_labelreturncxt||kr|Sdt|d}|rd|d}|d|t|z |zS)z Truncates result text to max_chars and appends advice for context safety. Used for multi-query batch: each (query, answer) message is capped so no single result fills context. u ... [TRUNCATED – original z> chars. Consider smaller window_days or TOP N to reduce rows.]u ... [TRUNCATED – z3; consider DATEADD/DATEDIFF or TOP to reduce rows.]N)len)rrrsuffixs C/var/www/html/userprofiledev.eatanceapp.com/core/context_manager.pycap_result_contentrsV  4yI -c$i[8v wF( 5hi ))c&k) *V 33messagesc 4 tjd}d}|D]7}|t|jt |j z }|dz }9|S#t $r7}tjd|td|DdzcYd}~Sd}~wwxYw)zF Estimates token count for a list of messages using tiktoken. cl100k_baserzError counting tokens: c3XK|]"}tt|j$yw)N)rstrcontent).0ms r zcount_tokens...s913s199~&s(*N) tiktoken get_encodingrencoderr Exceptionloggererrorsum)rencoding num_tokensmsges r count_tokensr/s ?((7 C #hooc#++.>?@ @J !OJ   ? .qc23999Q>>?sAA B ,B BBcvt|}|tkr|Stjd|dtdg}|D]}t |t rt t|jtkDr~t|jdtdt t|jdz}t ||j|j|j}|j||j|t|}tjd||tkr|Stjd |Dcgc]}t |ts|}}|Dcgc]}t |tr|}}t |d krtjd |S|dd } |d d} t!| } td | } || gz| z} tjdt | | Scc}wcc}w#t"$r(}tj%d|d|| zcYd}~Sd}~wwxYw)z Proactively prunes messages if they exceed the SAFE_THRESHOLD. Strategy: 1. Truncate large ToolOutputs first (they are usually the culprit). 2. If still over, drop oldest history (excluding System Prompt). zContext Usage High (z tokens). Pruning to target ...Nz& ... [TRUNCATED SYSTEM: Original size z chars])r tool_call_idnameidz,Pruning successful (Truncation). New count: z3Truncation insufficient. Summarizing older history.z:Not enough history to summarize. Returning truncated list.zPREVIOUS CONTEXT SUMMARY: r z-Summarization complete. Final message count: zSummarization failed: z'. Falling back to drop-oldest strategy.)r/ TARGET_TOKENSr(warning isinstancerrrr MAX_CHARS_PER_RESULTr2r3r4appendinforsummarize_historyr'r))rcurrent_tokenspruned_messagesr-truncated_contentnew_msgr" system_msgs non_system to_summarizerecent_history summary_text summary_msgfinal_messagesr.s rprune_messagesrJ0s."(+N % NN).)99UVcUddghiO c; 'CCKK0@,ADX,XCKK !6"67;CCKK@P~>NOP % NNHI.NoA}1M1oKN,Q_Jq-4P!_JQ :!STcr?L_N ,(6 $.H,WX $ }4~E CCDWCXYZ'OQ( , -aS0WXY^++,s7 G=!G=+HH7AH H8H3-H83H8c|sytd}d}|D]R}|jj}t|j}t |dkDr|dddz}||d|d z }Td |d } |j t| g}|jS#t$r"}tjd |Yd}~yd}~wwxYw)zP Uses the LLM to summarize a list of messages into a concise narrative. z No history. temperatureriNr1:  z Summarize the following conversation history into a concise paragraph. Focus on the SQL queries run and the key insights found. Ignore detailed JSON data, just capture the high-level findings. HISTORY: z r7zError calling LLM for summary: zError generating summary.) rtypeupperrr rinvokerr'r(r)) rllmconversation_textr"roler promptresponser.s rr>r>qs  c "C vv||~aii. w<# dsme+GvRy33   F+::|F;<= + 6qc:;*+s0'B C!B>>Cc |sgS|d}t}t|dr(|jr|jDchc]}|d }}g}|D]}t|ts|j |vs#t t|jdkDsEtjd|j d|jt d|j |j|j|Scc}w) z Identifies 'old' ToolMessages that are no longer part of the active tool call batch and returns placeholder updates to wipe their content (Volatile Memory). Usage: Call this when entering a NEW tool execution phase. tool_callsr4dz$Volatile Memory: Wiping ToolMessage z (Data processed)z'[Data Processed & Removed from History])r r2r4r3)sethasattrr[r:rr2rrr r(r=r<r4r3)rlast_msgcurrent_tool_call_idstccleanup_updatesr"s rget_volatile_cleanup_updatesrcs |H Ex&8+>+>4<4G4G H4GbD4G HO  a %!..@U*UC N#c)CANNCSSdef '' F"#..&& )  !!Is C4r c|rd|vsd|vry|jdd}t|dk7ry|dj}d|vr^d|vrZ|jdddjddj}|jdddj}||fSd|vr'|jdddj}d|fSy) z Parse ToolMessage content (hypothesis: ...\nquery: ...\nanswer: ...) into (hypothesis, query). Returns None if the format is not recognized. zquery:zanswer:Nrrz hypothesis:r)splitrstripreplace)r partsheadh_partq_parts r_parse_tool_message_contentrms hg-'1I MM)Q 'E 5zQ 8>> DT!1Ha(+33M2FLLNHa(+1134Ha(+113F| raThis SQL query returned too much data and caused a context limit error. Return the SAME query with a STRICTER date filter (e.g. last 30 days or 7 days) to reduce rows. Change only the date range; do not change other logic. Output ONLY the SQL statement, no explanation or markdown.queryc|xsdjs|xsdS td}td|}|jt |g}t |ddxsdj}|r=d|vr7t jd |}|r|jd j}|S |S#t$r$}tjd |d Yd}~|Sd}~wwxYw) z Calls the LLM to return the same query with a reduced date window. On failure returns the original query so the pipeline can continue. rrLrMz Query: r7r Nz```z```(?:\w*)\s*([\s\S]*?)```rz%rewrite_query_reduced_window failed: z; using original query.) rgrREDUCE_WINDOW_PROMPTrSrgetattrresearchgroupr'r(r9)rnrTrWrXnew_sqlr"r.s rrewrite_query_reduced_windowrvs KR   { [#&()eW=::|F;<=8Y5;BBD II;WEggaj..0GN  L [>qcAXYZZ L[sBB00 C9CC max_retriesexecute_sql_fnct|}t|dzD]} |j|cSy #tjtj t f$r}d}t|tjr9dt|jvxsdt|jv}nqt|tj r|jdk(}nGdt|jvxs*dt|jvxs dt|v}|r||kstjd||tjd|dzd ||rt|d ts||d }t|jxsd } t!| } d } |ra| r_| \} } t#| } || |} tj%d n/#t $r#}tjd|dYd }~nd }~wwxYw| dt'| d} t| |j(|j*|d <Yd }~(d }~wwxYw)a Invokes the model with retry logic for context overflow (400) or payload too large (413). When the last message is a ToolMessage and execute_sql_fn is provided: parses the query, asks the LLM for a reduced-date-window version, runs it via execute_sql_fn, replaces the ToolMessage content with the smaller result, and retries. Otherwise replaces with a short error message and retries. rFcontexttokeni413zUnrecoverable LLM error: z!Context/Payload error on attempt rOrZrNzGRe-ran query with reduced date window and replaced ToolMessage content.zexecute_sql_fn failed: z ; falling back to error message.zdSYSTEM ERROR: The tool output was too large and exceeded the model's context limit. Result size was zY chars. PLEASE RE-TRY with a DATE FILTER (e.g., last 30 or 7 days) to reduce data volume.)r r2r3)listrangerSopenaiBadRequestErrorAPIStatusErrorr'r:rlower status_coder(r)r9rr rmrvr=rr2r3)modelrrwrxcurrent_messagesattemptr.is_context_413 last_toolr parsed new_content hypothesisrn new_queryrun_errs rinvoke_with_retryrs,H~q). << 01 1*&&(=(=yI, "N!V334!*c!flln!@YAv445!"#!5!*c!flln!@Y!l]bfijkfl]l"w'< 8<= NN>w{m2aSQ R#:6Fr6JK+X(,I)++1r2G09FK&$*! E8? h"0Y"GKKK ij hNN%9I>H9II)N)#rrr$langchain_core.messagesrrrrr logger_configr typingr r r r llm_providerrr__name__r( MAX_TOKENSSAFE_THRESHOLDintr8r;rrr/rJr>rcrmrprvrrrrsO dd%22! H  J/0 3G\^ 4S 4S 4VY 4cf 4?4 ,??$?,T+.?,4 3D?,B!+[ 1!+c!+H!4 +<!kAR!H%S/1J*> 4:> >>XsCj#o67 >r