A foundation model for DNA
The problem. Protein language models learned to read amino acids. But DNA is the more general substrate — genes, regulatory elements, ncRNAs, whole operons — and modeling it at single-nucleotide resolution across long ranges had been out of reach. Could one model read and write DNA from molecule to genome scale?
The idea. Evo is a 7-billion-parameter model trained on millions of prokaryotic and phage genomes at byte-level (single-nucleotide) resolution, with a context window into the 100-kilobase range. The architectural trick is StripedHyena — a hybrid of data-controlled convolutions and attention — which buys long context at single-nt resolution without a pure transformer’s quadratic cost. It does zero-shot prediction (the fitness effect of mutations across coding, non-coding, and regulatory sequence) and generation: it designs plausible CRISPR–Cas systems, transposons, and even megabase-scale genomic sequence.
Why it matters. This is where my own world (genomic pipelines producing sequence) meets the model world head-on. The same tokens-and-embeddings machinery I use over text and proteins, applied to the most fundamental sequence of all — and it’s generative, so it points at design, not just annotation. It’s the natural DNA-scale companion to AlphaFold and ESM, and the most concrete argument that a “read/write” interface to genomes is coming.
Verdict. Genuinely a frontier result, and refreshingly honest about the gap that matters: generated sequences are plausible, not validated — a model that produces genome-shaped text is not a model that produces a living organism. It’s also prokaryote-centric for now. Read it for where the field is heading, and hold the “does it fold / does it live” skepticism the design papers earned. Ties directly to where my pipelines could feed or consume such a model.