Release

Training moves to TPU

An exploded view of stacked processor chip layers, with one layer highlighted in ember orange, illustrating the move to TPU-based training. loading=lazy fetchpriority=auto />

The Kerven Vega 1 training pipeline now runs on a TPU v5e-8, granted through Google's TPU Research Cloud.

The practical reason is dull and decisive: PyTorch's TPU support is a translation layer, and JAX's is not. Rewriting the fine-tuning loop in JAX and Flax cost a week and bought back the compute budget of a small company.

Synthetic data generation is next. Twenty to thirty thousand examples of AI-written code with real, injected, verifiable bugs, then supervised fine-tuning, then GRPO against a reward that can actually be checked.

← All news