U h@s|ddlmZddlmZmZmZmZmZmZddl m Z ddl m Z ddl mZddlmZddlmZGdd d e Zd S) )partial)AnyDictListMappingOptionalSet)CallbackManagerForLLMRun)LLM)Field)pre_init)enforce_stop_tokensc@s\eZdZUdZeed<edddZeeed<edddZ e ed<edd dZ e ed <ed d dZ e ed <ed d dZ eed <ed ddZeed<ed ddZeed<ed ddZeed<ed ddZeed<edddZee ed<dZee ed<dZeeed<dZeeed<dZee ed<d Zeeed<gZeeeed<dZee ed<d Zeeed!<ed"d#dZe ed#<d Zeed$<d Z eed%<ed&d'dZ!eeed'<dZ"e#ed(<Gd)d*d*Z$e%e&ed+d,d-Z'e(ee#fd+d.d/Z)e*e(e(d0d1d2Z+e,e-ee#fd+d3d4Z.e,ed+d5d6Z/d:eeeeee0e#ed7d8d9Z1dS);GPT4AllaGPT4All language models. To use, you should have the ``gpt4all`` python package installed, the pre-trained model file, and the model's config information. Example: .. code-block:: python from langchain_community.llms import GPT4All model = GPT4All(model="./models/gpt4all-model.bin", n_threads=8) # Simplest invocation response = model.invoke("Once upon a time, ") modelNbackend)alias max_tokensn_partsrseedFf16_kv logits_all vocab_only use_mlock embedding n_threads n_predictgffffff?tempg?top_p(top_kechostop@ repeat_last_ngzG?repeat_penaltyn_batch streamingallow_downloadcpudeviceclientc@seZdZdZdS)zGPT4All.ConfigZforbidN)__name__ __module__ __qualname__extrar4r4D/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/gpt4all.pyConfigcsr6)returnc Csddddddddd h S) Nrrr#r!r r*r(r'r+r4r4r4r4r5_model_param_namesfszGPT4All._model_param_namesc Cs*|j|j|j|j|j|j|j|j|jd S)N rrr#r!r r*r(r'r+r9selfr4r4r5_default_paramstszGPT4All._default_params)valuesr7cCszddlm}Wntk r,tdYnX|d}|d\}}}||7}|||pXd|d|d|d d |d <|d dk r|d j|d z|d j|d<Wn$tk r|d jj|d<YnX|S) z;Validate that the python package exists in the environment.r)rzVCould not import gpt4all python package. Please install it with `pip install gpt4all`.r/Nrr,r.) model_path model_typer,r.r/r)gpt4allr ImportError rpartitionrZset_thread_countr@AttributeError)clsr=Z GPT4AllModel full_pathr? delimiterZ model_namer4r4r5validate_environments.   zGPT4All.validate_environmentcs(djifddjDS)zGet the identifying parameters.rcs"i|]\}}|kr||qSr4)r8).0kvr:r4r5 s z/GPT4All._identifying_params..)rr<__dict__itemsr:r4r:r5_identifying_paramss zGPT4All._identifying_paramscCsdS)zReturn the type of llm.rAr4r:r4r4r5 _llm_typeszGPT4All._llm_type)promptr% run_managerkwargsr7c Kshd}|rt|j|jd}d}||}|jj|f|D]}|rH||||7}q8|dk rdt||}|S)aCall out to GPT4All's generate method. Args: prompt: The prompt to pass into the model. stop: A list of strings to stop generation when encountered. Returns: The string generated by the model. Example: .. code-block:: python prompt = "Once upon a time, " response = model.invoke(prompt, n_predict=55) N)verbose)rZon_llm_new_tokenrTr<r/generater ) r;rQr%rRrSZ text_callbacktextparamstokenr4r4r5_calls   z GPT4All._call)NN)2r0r1r2__doc__str__annotations__r rrrintrrrboolrrrrrrr floatr!r#r$r%rr'r(r*r+r,r.r/rr6 staticmethodrr8rr<r rHpropertyrrOrPr rZr4r4r4r5r sX      !  rN) functoolsrtypingrrrrrrZlangchain_core.callbacksr Z#langchain_core.language_models.llmsr Zlangchain_core.pydantic_v1r Zlangchain_core.utilsr Zlangchain_community.llms.utilsr rr4r4r4r5s