sappho192 

.NET wrapper of HuggingFace Tokenizers library

Native(Rust) wrapper of HuggingFace Tokenizers library.

Minimal Tokenizer implementation of BertJapanese(tohoku-nlp/bert-base-japanese) in C#

Text translator library based on LLM models, especially EncoderDecoderModel in HuggingFace

Native(Rust) wrapper of HuggingFace Tokenizers library.

This fork is a lightweight version of the original library and only has ChatLog functionality.

Native(Rust) wrapper of HuggingFace Tokenizers library.