NLP Lineage

8 February 2022 · Language modelling

AlphaCode

Competition-Level Code Generation with AlphaCode

Y. Li, D. Choi, J. Chung, et al. (26 authors)

Date
8 February 2022
What the date marks
arXiv submission
Kind
Model
Organisation
DeepMind
Access
Not applicable
Other dates
Science 2022
Threads
In the guided tour
Chapter 12. Thinking longer
Learning phases
3. API usage and prompting

Notable: no later milestone in the data is documented as descending from it. How levels are decided

Full summary in progress. Until then, this page shows the milestone's record from the research data.

What it changed

Before it

Code models produced one attempt per problem.

The problem

Competitive programming problems are too hard to solve first try.

What it introduced

Generate a million candidate programs, filter by running the examples, and cluster to pick submissions.

Why it matters

An early argument that spending more compute at inference buys accuracy, which is the test-time compute thesis.

What modern models inherit

Sampling widely and filtering, rather than trusting a single generation.

What came next

Self-consistency, verifier-guided search and eventually reasoning models.

Before and after

The milestones it descends from, and the milestones that descend from it. Work developed alongside it is not counted. Weak links are left out unless you include them.

Before: where it came from

No documented ancestors are recorded for AlphaCode without weak links.

No documented ancestors are recorded for AlphaCode without weak links.

No recorded ancestors are recorded for AlphaCode.

No recorded ancestors are recorded for AlphaCode.

After: what it led to

No documented descendants are recorded for AlphaCode without weak links.

No documented descendants are recorded for AlphaCode without weak links.

No recorded descendants are recorded for AlphaCode.

No recorded descendants are recorded for AlphaCode.

Direct links and their sources

Where it came from

Developed alongside

What it led to

None recorded in the sources used.