U h@s~dZddlZddlmZddlmZmZmZddlm Z ddl m Z e e ee eddd Zeed d d ZGd dde ZdS)zLoads .ipynb notebook files.N)Path)AnyListUnion)Document) BaseLoader)cellinclude_outputsmax_output_length tracebackreturnc Cs,|d}|d}|r6z |d}Wntk r4YnX|r|dkr|rd|dkr|dd}|dd}|r|dd}d |d |d |d |d |d Sd |d |d |d|d SnL|dddkr(|dd}t|t|} d |d |d|d| dSnd |d |dSdS)asCombine cells information in a readable format ready to be used. Args: cell: A dictionary include_outputs: Whether to include the outputs of the cell. max_output_length: Maximum length of the output to be displayed. traceback: Whether to return a traceback of the error. Returns: A string with the cell information. cell_typesourceoutputscodeZenamerZevaluer 'z ' cell: 'z' , gives error 'z', with description 'z' and traceback 'z' z',with description ' output_typestreamtextz' with output: 'N)KeyErrorkeysminlen) rr r r r routputZ error_nameZ error_valueZ min_outputrQ/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/document_loaders/notebook.pyconcatenate_cells s0    " r)xr cCsRt|tr|ddSt|tr.dd|DSt|trJdd|DS|SdS)zMRecursively remove newlines, no matter the data structure they are stored in. rcSsg|] }t|qSrremove_newlines).0elemrrr Fsz#remove_newlines..cSsi|]\}}|t|qSrr r"kvrrr Hsz#remove_newlines..N) isinstancestrreplacelistdictitemsrrrrr!@s    r!c@sBeZdZdZd eeefeeeedddZ e e ddd Z d S) NotebookLoaderz'Load `Jupyter notebook` (.ipynb) files.F )pathr r remove_newliner cCs"||_||_||_||_||_dS)aInitialize with a path. Args: path: The path to load the notebook from. include_outputs: Whether to include the outputs of the cell. Defaults to False. max_output_length: Maximum length of the output to be displayed. Defaults to 10. remove_newline: Whether to remove newlines from the notebook. Defaults to False. traceback: Whether to return a traceback of the error. Defaults to False. N) file_pathr r r3r )selfr2r r r3r rrr__init__Ps zNotebookLoader.__init__)r c stj}t|dd}t|}W5QRXdd|dD}jrRttt|}d ttfdd|}d t |i}t ||d gS) zLoad documents.utf8)encodingcSsg|]}dd|DqS)cSsi|]\}}|dkr||qS))r rrrr%rrrr(usz2NotebookLoader.load...)r.)r"rrrrr$tsz'NotebookLoader.load..cellsrcst|jjjS)N)rr r r r/r5rrs z%NotebookLoader.load..r)Z page_contentmetadata) rr4openjsonloadr3r,mapr!joinr*r)r5pfdZ filtered_datarr<rr:rr?ks$   zNotebookLoader.loadN)Fr1FF) __name__ __module__ __qualname____doc__rr*rboolintr6rrr?rrrrr0Ms  r0)rHr>pathlibrtypingrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baserr-rIrJr*rr!r0rrrrs    4