Kronecker Embeddings: byte-level structured token representations for parameter-efficient language models. Reference implementation.
-
Updated
May 29, 2026 - Python
#
byte-level
Here are 11 public repositories matching this topic...
🐍This is a fast, lightweight, and clean CPython extension for the Byte Pair Encoding (BPE) algorithm, which is commonly used in LLM tokenization and NLP tasks.
-
Updated
Jun 17, 2026 - Python
An efficient openblocks parser module.
-
Updated
Apr 14, 2021 - Java
A deterministic byte-level BPE tokenizer in pure Python, built from scratch with strict tests, typed code, and polished docs.
-
Updated
Jun 29, 2026 - Python
A tiny byte-level multi-head content classifier (~1.5M params, ~200KB ONNX, <6ms). Classifies code, text, markup, config, images, binary, secrets, 62 code languages, 30 text languages, 90 MIME types from raw bytes — no tokenizer needed.
multilingual classifier open-source clipboard machine-learning language-detection pytorch byte-level onnx edge-ai multi-head code-detection content-classification onnx-runtime tiny-model
-
Updated
Jun 29, 2026 - Makefile
An editable, auditable 807K-param byte-level LLM: CRUD single facts with provable per-edit locality, and abstain when unsure instead of guessing. CPU, offline.
machine-learning crud cpu pytorch grace knowledge-base language-model byte-level interpretability rome serac abstention tiny-ml selective-prediction llm model-editing knowledge-editing memit
-
Updated
Jun 20, 2026 - Python
NeuralPiece: An adaptive byte-level neural tokenizer designed to surpass traditional BPE and Unigram via deep learning chunking.
nlp machine-learning deep-learning tokenizer pytorch neural-networks byte-level bpe sentencepiece llm subword-tokenization
-
Updated
Jun 12, 2026 - Python
Engram without a tokenizer
machine-learning transformers pytorch ngram byte-level huggingface engram deepseek causal-lm tokenizer-free deterministic-lookup
-
Updated
Jan 13, 2026 - Python
File security system using remote authentication
-
Updated
Dec 18, 2019 - C#
Byte-level 16MB language model — the only byte-level submission in 622+ OpenAI Parameter Golf entries. Built the right size, not shrunk from the wrong one.
python nlp machine-learning deep-learning transformer openai language-model byte-level parameter-golf
-
Updated
Apr 13, 2026 - Python
Non-learned byte-level signal encoder for PyTorch - one modality-agnostic 27-D exact base (anchor rule, Delta = Gray code), losslessly invertible. pip install hsl-embedding
-
Updated
Jun 11, 2026 - Python
Improve this page
Add a description, image, and links to the byte-level topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the byte-level topic, visit your repo's landing page and select "manage topics."