U h @s^ddlZddlZddlmZmZmZmZddlmZddl m Z e e Z Gddde ZdS)N)DictListOptionalSequence)Document) BaseLoaderc@s`eZdZdZdddeeeeeeeeddddZe e ddd Z e e dd d Z dS) MongodbLoaderzLoad MongoDB documents.N)filter_criteria field_names)connection_stringdb_namecollection_namer r returnc Cszddlm}Wn,tk r<}ztd|W5d}~XYnX|sJtd|sVtd|sbtd|||_||_||_||_|pi|_|j ||_ |j ||_ dS)Nr)AsyncIOMotorClientzBCannot import from motor, please install with `pip install motor`.z#connection_string must be provided.zdb_name must be provided.z!collection_name must be provided.) Zmotor.motor_asyncior ImportError ValueErrorclientr r r r Z get_databasedbZget_collection collection)selfr r r r r rerP/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/document_loaders/mongodb.py__init__s*   zMongodbLoader.__init__)rcCst|S)aLoad data into Document objects. Attention: This implementation starts an asyncio event loop which will only work if running in a sync env. In an async env, it should fail since there is already an event loop running. This code should be updated to kick off the event loop from a separate thread if running within an async context. )asynciorunaload)rrrrload0s zMongodbLoader.loadc sg}|j|jIdH}|jr.dd|jDnd}|j|j|2z3dHW}|j|jd}|jdk ri}|jD]>}|d}|} |D]} | | kr| | } qd} qq| ||<qpdd|D} d | } nt |} | t | |d qB6t ||krtd t |d |d|S) z Load data into Document objects.NcSsi|] }|dqS)r).0fieldrrr Esz'MongodbLoader.aload..)Zdatabaser.cSsg|] }t|qSr)str)rvaluerrr ]sz'MongodbLoader.aload.. )Z page_contentmetadataz6Only partial collection of documents returned. Loaded z docs, expected )rZcount_documentsr r findr r splitvaluesjoinr$appendrlenloggerwarning) rresultZ total_docsZ projectiondocr(fieldsnamekeysr%keyZtextstextrrrr>s8      zMongodbLoader.aload) __name__ __module__ __qualname____doc__r$rrrrrrrrrrrrr s  !r)rloggingtypingrrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baser getLoggerr8r/rrrrrs