Build a language model from scratch — 50 million parameters max. Architecture, data, and training — entirely your call. Competition duration. Go.
PRIZES
TBA
LLM
Curate your dataset, design your architecture, and pre-train an LLM from scratch. Focus on data quality and training efficiency.
Models are evaluated on perplexity, reasoning benchmarks, and efficiency metrics. Novel approaches earn bonus points.
Present your approach in a 5-minute lightning talk. Explain your architecture, training strategy, and key learnings.
THE PROBLEM
Language models are transforming every industry, but training them remains inaccessible to most. GIBC V2 challenges you to build a competitive model — pushing the boundaries of what small-scale LLMs can achieve.
CONSTRAINTS
NO PROVIDED RESOURCES
Bring your own infrastructure. No GPUs, no datasets, no baseline models provided. Your setup, your stack, your rules — build however you want.
SKILLS NEEDED
Kickoff & Briefing
Track intro, rules, Q&A. Hacking begins at noon.
Hacking Begins
10-week clock starts. Build your stack, train your model, break things.
Mentor Office Hours
Scheduled check-ins with ML engineers for guidance on training, debugging, and optimization.
Training Deadline
Submit models for evaluation. Leaderboard updates in real-time.
Presentations & Awards
5-min lightning talks. Winners announced at closing ceremony.
Language modeling quality on held-out validation sets. Lower perplexity and higher benchmark accuracy score higher.
Performance on logic, math, and commonsense reasoning tasks. Evaluated through standardized benchmarks.
Compute efficiency, training speed, and memory footprint. Efficient architectures and training strategies rewarded.
Novel architecture decisions, creative data strategies, or unique training approaches. Bonus for originality.
Prize details are still being finalised. Check back soon — we're putting together something worth building for.
Bring your own stack, build your own model. Competition duration. No limits. Registration closes July 10, 2026.