U h@s<ddlmZddlmZmZddlmZGdddeZdS)) annotations)AnyList) TextSplittercs>eZdZdZddddddfdd Zdd d d d ZZS)NLTKTextSplitterz"Splitting text using NLTK package. englishstrrNone) separatorlanguagekwargsreturnc sRtjf|zddlm}||_Wntk r@tdYnX||_||_dS)zInitialize the NLTK splitter.r) sent_tokenizezANLTK is not installed, please install it with `pip install nltk`.N)super__init__Z nltk.tokenizer _tokenizer ImportError _separator _language)selfr r r r __class__A/tmp/pip-unpacked-wheel-a648t6hw/langchain_text_splitters/nltk.pyr s   zNLTKTextSplitter.__init__z List[str])textrcCs|j||jd}|||jS)z&Split incoming text and return chunks.)r )rrZ _merge_splitsr)rrsplitsrrr split_textszNLTKTextSplitter.split_text)rr)__name__ __module__ __qualname____doc__rr __classcell__rrrrrs rN) __future__rtypingrrZlangchain_text_splitters.baserrrrrrs