U h@sxddlmZmZmZmZmZmZddlmZddl m Z eee efe dddZ Gddde ZGd d d e Zd S) )AnyCallableIteratorListOptionalTuple)Document) BaseLoader)docsreturncCsddd|DS)z#Default joiner for content columns. cSsg|] }|dqS)).0docrrR/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/document_loaders/rocksetdb.py sz"default_joiner..)join)r rrrdefault_joinersrcs(eZdZdZeedfdd ZZS)ColumnNotFoundErrorzColumn not found error.) missing_keyquerycstd|d|dS)NzColumn "z" not selected in query: )super__init__)selfrr __class__rrrszColumnNotFoundError.__init__)__name__ __module__ __qualname____doc__strr __classcell__rrrrr src @s`eZdZdZdefeeeeeeee ee eefgefdddZ e e dddZdS) RocksetLoaderaLoad from a `Rockset` database. To use, you should have the `rockset` python package installed. Example: .. code-block:: python # This code will load 3 records from the "langchain_demo" # collection as Documents, with the `text` column used as # the content from langchain_community.document_loaders import RocksetLoader from rockset import RocksetClient, Regions, models loader = RocksetLoader( RocksetClient(Regions.usw2a1, ""), models.QueryRequestSql( query="select * from langchain_demo limit 3" ), ["text"] ) ) N)clientr content_keys metadata_keyscontent_columns_joinerc Csz ddlm}m}ddlm}Wntk r<tdYnXt||sZtdt|t||svtdt|||_ ||_ ||_ ||_ ||_ ||_||_z|j dWntk rYnXdS) aKInitialize with Rockset client. Args: client: Rockset client object. query: Rockset query object. content_keys: The collection columns to be written into the `page_content` of the Documents. metadata_keys: The collection columns to be written into the `metadata` of the Documents. By default, this is all the keys in the document. content_columns_joiner: Method that joins content_keys and its values into a string. It's method that takes in a List[Tuple[str, Any]]], representing a list of tuples of (column name, column value). By default, this is a method that joins each column value with a new line. This method is only relevant if there are multiple content_keys. r)QueryPaginator RocksetClient)QueryRequestSqlz]Could not import rockset client python package. Please install it with `pip install rockset`.z;client should be an instance of rockset.RocksetClient, got zBquery should be an instance of rockset.model.QueryRequestSql, got Z langchainN)Zrocksetr(r)Zrockset.modelsr* ImportError isinstance ValueErrortyper$rr%r'r&Z paginatorZ request_modelZset_applicationAttributeError) rr$rr%r&r'r(r)r*rrrr-s4     zRocksetLoader.__init__)r c #s|jjj|jdj}|D]zFt|fdd|jD|jdk rVfdd|jDndVWqtk r}zt |j d|jW5d}~XYqXqdS)N)Zsqlcsg|]}||fqSrrrcolrrrrosz+RocksetLoader.lazy_load..csi|]}||qSrrr0r2rr qsz+RocksetLoader.lazy_load..)Z page_contentmetadatar) r$ZQueriesrresultsrr'r%r&KeyErrorrargs)rZ query_resultserr2r lazy_loadgs(  zRocksetLoader.lazy_load)rrrr rrrr!rrrrrrr9rrrrr#s  :r#N)typingrrrrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baser r!r Exceptionrr#rrrrs