U hX@s\ddlZddlZddlZddlmZmZmZmZddl m Z ddl m Z Gddde Z dS)N)AnyListMappingOptional)CallbackManagerForLLMRun)LLMc@s~eZdZUdZeeed<dZeeed<e edddZ deee eee e ed d d Ze eee fdd d ZdS)NIBittensorLLMaNIBittensor LLMs NIBittensorLLM is created by Neural Internet (https://neuralinternet.ai/), powered by Bittensor, a decentralized network full of different AI models. To analyze API_KEYS and logs of your usage visit https://api.neuralinternet.ai/api-keys https://api.neuralinternet.ai/logs Example: .. code-block:: python from langchain_community.llms import NIBittensorLLM llm = NIBittensorLLM() system_promptr top_responses)returncCsdS)Nrselfr r F/tmp/pip-unpacked-wheel-9gdii04g/langchain_community/llms/bittensor.py _llm_type"szNIBittensorLLM._llm_typeN)promptstop run_managerkwargsr c Kst}d|_tjjd|d}t|jtr8t d|j}nd}d}|j dkrT|d} n|t |j } | d d | } | d d d dd } t| } | dd} dd| dd}|j d d|d| }|d d d dd }t|}t|tr|r|s|D]}zt|gd| dd|dgd}| dd||| }|d d d dd }t|}d|krWq|dddd}||WStk rYqYnXqzt|d| dd|dgd}| dd||| }|d d d dd }|rB||WSt|}|dddd}||WStk r}z&|j d d |d!||dWYd"Sd}~XYnXdS)#a Wrapper around the bittensor top miner models. Its built by Neural Internet. Call the Neural Internet's BTVEP Server and return the output. Parameters (optional): system_prompt(str): A system prompt defining how your model should respond. top_responses(int): Total top miner responses to retrieve from Bittensor protocol. Return: The generated response(s). Example: .. code-block:: python from langchain_community.llms import NIBittensorLLM llm = NIBittensorLLM(system_prompt="Act like you are programmer with 5+ years of experience.") Tztest.neuralinternet.ai)contextdrzwYou are an assistant which is created by Neural Internet(NI) in decentralized network named as a Bittensor.Nz? Your task is to provide accurate response based on user promptGETz/admin/api-keys/zutf-8  api_keyzapplication/jsonzBearer z 2023-05-19)z Content-Type AuthorizationzEndpoint-Versionz/top_miner_uids)headerssystem)rolecontentuser)uidsmessagesPOSTz/chatchoicesmessager )top_nr#z /error_msg?e=z&p=zBSorry I am unable to provide response now, Please try again later.)sslcreate_default_contextcheck_hostnamehttpclientHTTPSConnection isinstancer intminr strrequest getresponsereaddecodereplacejsonloadslistdumpsclose Exception)rrrrrrconnr'Zdefault_promptr Zapi_key_responseZ api_keys_dataZ api_keys_jsonrrZminer_responseZ miner_datar"uidpayloadZ init_responseZ init_dataZ init_jsonZreplyresponseZ utf_stringZ json_resper r r_call&s            zNIBittensorLLM._callcCs|j|jdS)zGet the identifying parameters.r r rCr r r r_identifying_paramssz"NIBittensorLLM._identifying_params)NN)__name__ __module__ __qualname____doc__rr1__annotations__r r/propertyrrrrrBrrDr r r rr s"    r) http.clientr+r7r(typingrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrrr r r rs