UK Public Sector GitHub Observatory
Language figures come from GitHub's own per-repository byte counts, which measure source rather than a single headline label. File counts and repository sizes come from the mirrors themselves. The two tell different stories, and the difference is the point.
The codebase
cmd-migration-401What stands out
cmd-migration-401 is 52.5 MB of git - a 2013 static snapshot of www.gov.uk, not source code. It single-handedly makes HTML the largest language by volume (5% of all source bytes). Any size or language statistic that does not exclude it is measuring an archive, not a codebase.
This organisation was harvested with blobless partial clones, which fetch every commit and file path but not file contents, so there is no local size to measure against. Checked elsewhere in this dataset against 1,526 fully mirrored repositories, GitHub's reported size is accurate to within about six percent.
Ruby is the primary language of 0% of archived repositories but only 0% of live ones. Python, Go, TypeScript and HCL have taken the difference - the signature of a shift from monolithic Rails publishing apps toward data pipelines, infrastructure-as-code and platform tooling.
83% of repositories are under a megabyte of git data. The estate is not a monolith - it is a very long tail of small services, gems and prototypes around a few large publishing applications.
Languages, two ways
By volume of source
Bytes of code. Dominated by archived static HTML.
By number of repositories
How many repositories name each language as their primary one. A better guide to what engineers actually work in.
Live estate versus archive
The same language ranking, split by whether the repository is still active. The shift is the clearest signal of technical direction in the whole dataset.
Active repositories
Archived repositories
Scale
Repository size distribution
Git data per repository, log-ish buckets.
Commits against files
Each circle is a repository, sized by number of distinct authors. Both axes are logarithmic. The diagonal band is the normal relationship between codebase size and churn; outliers above it are long-lived apps with heavy iteration, below it are dumps and imports.
The shape of a repository
Directory layout is the cheapest reliable signal of what a repository actually is.
app/ with config/ and spec/ is a Rails application;
src/ with test/ is Java or Node. Counted by how many repositories
contain each top-level directory at HEAD.
Most common top-level directories
Most common file extensions
By total file count across the estate.
The twenty largest repositories
| Repository | Language | Git size | Commits | Files | Status |
|---|---|---|---|---|---|
| cmd-migration-401 | Jupyter Notebook | 52.5 MB | 24 | 9 | active |
| databaker_docs | HTML | 22.9 MB | 90 | 322 | active |
| cmd-national-population-projections | Jupyter Notebook | 21.4 MB | 15 | 13 | active |
| cmd-weekly-deaths | Python | 14.8 MB | 36 | 7 | active |
| cmd-ashe | - | 11.6 MB | 29 | 2 | active |
| cmd-crime-with-home-office | Jupyter Notebook | 6.9 MB | 24 | 8 | active |
| dp-opendata-upload | Python | 3.5 MB | 176 | 83 | active |
| cmd-death-related-drugs | Jupyter Notebook | 1.2 MB | 2 | 3 | active |
| cmd-business-investment-gfcf-industry-asset | Jupyter Notebook | 842.8 kB | 13 | 7 | active |
| Databaker_Walkthrough_1 | Jupyter Notebook | 571.4 kB | 10 | 27 | active |
| cmd-buis-invest-capital-formation | Jupyter Notebook | 551.9 kB | 5 | 3 | active |
| cmd-uk-business | Jupyter Notebook | 551.9 kB | 2 | 3 | active |
| cmd-wellbeing-initial | Jupyter Notebook | 550.9 kB | 3 | 4 | active |
| databaker_example_travelTrends1 | Jupyter Notebook | 468.0 kB | 8 | 5 | active |
| cmd-transforms | Python | 329.7 kB | 221 | 59 | active |
| bau_FDI-Assets | Python | 302.1 kB | 31 | 20 | active |
| bau_OCI | Python | 191.5 kB | 27 | 30 | active |
| cmd-databaker-utils | Python | 174.1 kB | 123 | 11 | active |
| cmd-wellbeing | Jupyter Notebook | 122.9 kB | 13 | 2 | active |
| cmd-v4-hierarchy-parent-injector | Python | 109.6 kB | 11 | 7 | active |