U h"@shddlmZmZmZmZmZddlmZddlm Z m Z ddl m Z erTddl mZGddde ZdS) ) TYPE_CHECKINGAnyCallableDictOptional)Document) BaseModelroot_validator)get_from_dict_or_envApifyDatasetLoaderc @s4eZdZUdZeed<eed<dZeeed<e dde e dd d Z dddd ee e e ge feeeeeed d ddZdddd ee e e ge feeeeeed d ddZdddd ee e e ge feeeeeed dddZdddd ee e e ge feeeeeed dddZdS) ApifyWrapperzWrapper around Apify. To use, you should have the ``apify-client`` python package installed, and the environment variable ``APIFY_API_TOKEN`` set with your API key, or pass `apify_api_token` as a named parameter to the constructor. apify_clientapify_client_asyncNapify_api_tokenT)pre)valuesreturnc Cst|dd}zxddlm}m}||}t|jd}rH|jdd7<||}t|jd}rr|jdd7<||d <||d <Wntk rtd YnX|S) zValidate environment. Validate that an Apify API token is set and the apify-client Python package exists in the current environment. rZAPIFY_API_TOKENr) ApifyClientApifyClientAsync httpx_clientz user-agentz; Origin/langchainhttpx_async_clientrrz`Could not import apify-client Python package. Please install it with `pip install apify-client`.)r rrrgetattr http_clientheaders ImportError) clsrrrrclientrZ async_clientrrG/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/utilities/apify.pyvalidate_environments.  z!ApifyWrapper.validate_environment)build memory_mbytes timeout_secsr )actor_id run_inputdataset_mapping_functionr!r"r#rc Cs6ddlm}|j|j||||d}||d|dS)aRun an Actor on the Apify platform and wait for results to be ready. Args: actor_id (str): The ID or name of the Actor on the Apify platform. run_input (Dict): The input object of the Actor that you're trying to run. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the Actor run's default dataset. rr r%r!r"r#defaultDatasetIdZ dataset_idr&)$langchain_community.document_loadersr ractorcall selfr$r%r&r!r"r#r Z actor_callrrr call_actor7s  zApifyWrapper.call_actorc s<ddlm}|j|j||||dIdH}||d|dS)aRun an Actor on the Apify platform and wait for results to be ready. Args: actor_id (str): The ID or name of the Actor on the Apify platform. run_input (Dict): The input object of the Actor that you're trying to run. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the Actor run's default dataset. rr r'Nr(r))r*r rr+r,r-rrr acall_actor_s   zApifyWrapper.acall_actor)task_id task_inputr&r!r"r#rc Cs6ddlm}|j|j||||d}||d|dS)Run a saved Actor task on Apify and wait for results to be ready. Args: task_id (str): The ID or name of the task on the Apify platform. task_input (Dict): The input object of the task that you're trying to run. Overrides the task's saved input. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the task run's default dataset. rr r2r!r"r#r(r))r*r rtaskr, r.r1r2r&r!r"r#r Z task_callrrrcall_actor_tasks  zApifyWrapper.call_actor_taskc s<ddlm}|j|j||||dIdH}||d|dS)r3rr r4Nr(r))r*r rr5r,r6rrracall_actor_tasks   zApifyWrapper.acall_actor_task)__name__ __module__ __qualname____doc__r__annotations__rrstrr rr rrintr/r0r7r8rrrrr sl &  .  .  / r N)typingrrrrrZlangchain_core.documentsrZlangchain_core.pydantic_v1rr Zlangchain_core.utilsr r*r r rrrrs