huggingface-tokenizers
About huggingface-tokenizers
Use when "tokenizers", "HuggingFace tokenizer", "BPE", "WordPiece", or asking about "train tokenizer", "custom vocabulary", "tokenization", "subword", "fast tokenizer", "encode text"
Install
Copy the command and run it in a terminal.
$
npx skills add https:/ / eyadsibai/ ltk --skill huggingface-tokenizersAfter installing, type/huggingface-tokenizersin Claude Code to confirm it loaded.
Comments
Markdown supported