U h@sddlZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZmZddlmZdd d d d d Zed d ddGddde ZdS)N)AnyDictListMappingOptional) deprecated)CallbackManagerForLLMRun)LLM)get_from_dict_or_envpre_init)enforce_stop_tokensZtranslation_textZ summary_textZgenerated_text) translationZ summarizationZconversationalztext-generationztext2text-generationz0.0.21z1.0z)langchain_huggingface.HuggingFaceEndpoint)ZremovalZalternative_importc@seZdZUdZeed<dZeeed<dZ eeed<dZ ee ed<dZ eeed<Gdd d Z eeed d d Zeeeefd ddZeed ddZdeeeeeeeedddZdS)HuggingFaceHubaHuggingFaceHub models. ! This class is deprecated, you should use HuggingFaceEndpoint instead. To use, you should have the ``huggingface_hub`` python package installed, and the environment variable ``HUGGINGFACEHUB_API_TOKEN`` set with your API token, or pass it as a named parameter to the constructor. Supports `text-generation`, `text2text-generation`, `conversational`, `translation`, and `summarization`. Example: .. code-block:: python from langchain_community.llms import HuggingFaceHub hf = HuggingFaceHub(repo_id="gpt2", huggingfacehub_api_token="my-api-key") clientNrepo_idtask model_kwargshuggingfacehub_api_tokenc@seZdZdZdS)zHuggingFaceHub.ConfigZforbidN)__name__ __module__ __qualname__extrarrL/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/huggingface_hub.pyConfig:sr)valuesreturncCst|dd}zddlm}m}|d}|||d}|dsb|sFtd||d j|d }|j|d<|dtkrtd |dd td ||d<Wnt k rt dYnX|S)z?Validate that api key and python package exists in environment.rZHUGGINGFACEHUB_API_TOKENr)HfApiInferenceClientr)modeltokenrz1Must specify either `repo_id` or `task`, or both.)r )rzGot invalid task z, currently only z are supportedrzfCould not import huggingface_hub python package. Please install it with `pip install huggingface_hub`.) r huggingface_hubrr ValueError model_infoZ pipeline_tagVALID_TASKS_DICTkeys ImportError)clsrrrrrrr#rrrvalidate_environment=s>     z#HuggingFaceHub.validate_environment)rcCs |jpi}|j|jdd|iS)zGet the identifying parameters.)rrr)rrr)self _model_kwargsrrr_identifying_paramsbs  z"HuggingFaceHub._identifying_paramscCsdS)zReturn type of llm.r!r)r)rrr _llm_typekszHuggingFaceHub._llm_type)promptstop run_managerkwargsrc Ks|jpi}||}|jj||d|jd}t|}d|krRtd|dt|j}t |t rt|d|} n||} |dk rt | |} | S)anCall out to HuggingFace Hub's inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = hf("Tell me a joke.") )inputs parameters)jsonrerrorzError raised by inference API: rN) rrpostrr3loadsdecoder"r$ isinstancelistr ) r)r-r.r/r0r*r2responseZ response_keytextrrr_callps     zHuggingFaceHub._call)NN)rrr__doc__r__annotations__rrstrrrdictrrr rr(propertyrr+r,rrr<rrrrrs, $ r)r3typingrrrrrZlangchain_core._api.deprecationrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zlangchain_core.utilsr r Zlangchain_community.llms.utilsr r$rrrrrs$