RAG Chunker
Split text into retrieval-friendly chunks with token-aware sizing and overlap.
Defaults: Token-based sizing, 350 tokens per chunk, 50 token overlap, tokenizer gpt-tokenizer-gpt4. Max recommended input: 200k characters.
Pure TypeScript GPT-4 tokenizer (cl100k_base, no WASM required)
Share this tool
Send the direct link or post it to your network.
Related tools
🤖
JS Tokenizers
Tokenize text using various AI tokenizers
😊
Sentiment Analysis
Analyze emotional tone of text using AI
🎯
Zero-Shot Classification
Classify text into custom categories without training using AI
🔍
Sentence Similarity
Generate embeddings and find semantic similarity between texts using AI
❓
Question Answering
Answer questions based on provided context using AI