Byte-12B
A fine-tuned AI model for engineering education
Byte-12B is ZyoraByte's own AI tutor — a 12-billion-parameter model fine-tuned from Gemma 4 12B to teach across all 24 engineering streams. It explains concepts patiently, works through real university exam questions, and adapts to how each student learns.
- Base model
- Gemma 4 12B (google/gemma-4-12B-it)
- Parameters
- 12 billion
- Fine-tuning
- QLoRA (4-bit) · Unsloth
- Training hardware
- 1× NVIDIA H100
- Context length
- 4,096 tokens
- Modality
- Text → Text
- Language
- English
- Domain
- Engineering education (all 24 streams)
- Developer
- Zyora Labs · ZyoraByte
- License
- Research & education (base Gemma terms apply)
What is Byte-12B?
Byte-12B is the AI tutor at the heart of ZyoraByte. It is a 12-billion-parameter language model fine-tuned from Gemma 4 12B to do one thing exceptionally well: help engineering students actually understand their coursework.
Unlike a general chatbot, Byte-12B is taught in a consistent tutor persona — patient, encouraging and Socratic. It explains from first principles, checks understanding, and adapts its depth to whether a student is confused, revising, or preparing for an exam.
Built for every engineering stream
ZyoraByte is not a computer-science tool with everything else bolted on. Byte-12B is department-agnostic by design, trained across all 24 engineering streams — mechanical, civil, ECE, EEE, chemical, biomedical and beyond — as first-class subjects.
- Concept explanation from first principles, tuned to a student's current level.
- Step-by-step worked solutions to real university problems.
- Exam-oriented practice drawn from genuine past papers.
- A consistent, encouraging tutor persona across every subject.
Taught on real coursework
Byte-12B is fine-tuned on two complementary sources. First, a large set of tutoring conversations generated in Byte's persona using a strong teacher model. Second — and crucially — real university exam papers, including Anna University and VIT past papers, converted into Byte-persona question-and-answer pairs.
This means the model's answers are grounded in the way students are actually assessed, spanning the breadth of engineering subjects rather than a narrow slice.
How it was trained
Byte-12B is a QLoRA (4-bit) fine-tune of Gemma 4 12B, trained with Unsloth on a single NVIDIA H100 with a 4,096-token context window. The pipeline is fully self-contained and reproducible.
- Base model: google/gemma-4-12B-it (12B parameters).
- Fine-tuning: QLoRA 4-bit adapters via Unsloth.
- Hardware: 1× NVIDIA H100.
- Context length: 4,096 tokens.
- Dataset: teacher-generated tutoring dialogues + real exam-paper Q&A.
Where to use Byte-12B
Byte-12B powers the tutoring experience inside ZyoraByte. Students interact with it directly in the app, where it is paired with retrieval over each college's exact current syllabus for accurate, curriculum-aligned answers.
# Byte-12B is served as a Gemma 4 12B base + LoRA adapter.
# Access it through the ZyoraByte app — no setup required.
Visit → https://zyorabyte.comScope & limitations
Byte-12B is built for engineering education. It is tuned for tutoring and exam preparation, not for safety-critical, legal, medical or financial advice. As with any language model it can make mistakes, so students are encouraged to verify final answers against their official course material.
Frequently asked questions
What is Byte-12B?
Byte-12B is Zyora Labs' education AI model — a 12-billion-parameter language model fine-tuned from Gemma 4 12B to act as an AI tutor for engineering students. It powers the ZyoraByte app.
What model is Byte-12B based on?
Byte-12B is fine-tuned from Google's Gemma 4 12B (google/gemma-4-12B-it) using QLoRA 4-bit adapters trained with Unsloth on a single NVIDIA H100.
Which subjects does Byte-12B cover?
Byte-12B is department-agnostic by design and covers all 24 engineering streams — including mechanical, civil, ECE, EEE, chemical and computer science — as first-class subjects.
How was Byte-12B trained?
It was fine-tuned on teacher-generated tutoring conversations plus real university exam papers, including Anna University and VIT past papers converted into tutor-style question-and-answer pairs.
How can I use Byte-12B?
Byte-12B is available through the ZyoraByte app at zyorabyte.com, where it is paired with retrieval over each college's exact current syllabus for curriculum-aligned answers.
Want to build with Byte-12B?