UK Public Sector GitHub Observatory
← all organisations

digital-land / Code

27 languages, 184.0 MB of source, and what the live estate is written in today.

Language figures come from GitHub's own per-repository byte counts, which measure source rather than a single headline label. File counts and repository sizes come from the mirrors themselves. The two tell different stories, and the difference is the point.

The codebase

27
languages in use
184.0 MB of source
370.2k
files at HEAD
across every analysed repository
0 B
on disk as mirrors
full history, every branch and tag
6.5 GB
largest repository
brownfield-land

What stands out

One archived repository holds 25% of all the bytes.

brownfield-land is 6.5 GB of git - a 2013 static snapshot of www.gov.uk, not source code. It single-handedly makes HTML the largest language by volume (48% of all source bytes). Any size or language statistic that does not exclude it is measuring an archive, not a codebase.

Sizes here are GitHub's reported figures.

This organisation was harvested with blobless partial clones, which fetch every commit and file path but not file contents, so there is no local size to measure against. Checked elsewhere in this dataset against 1,526 fully mirrored repositories, GitHub's reported size is accurate to within about six percent.

Ruby is the house language, but its share is falling.

Ruby is the primary language of 0% of archived repositories but only 0% of live ones. Python, Go, TypeScript and HCL have taken the difference - the signature of a shift from monolithic Rails publishing apps toward data pipelines, infrastructure-as-code and platform tooling.

Most repositories are small; a handful are enormous.

51% of repositories are under a megabyte of git data. The estate is not a monolith - it is a very long tail of small services, gems and prototypes around a few large publishing applications.

Languages, two ways

By volume of source

Bytes of code. Dominated by archived static HTML.

HTMLHTML: 87.6 MB87.6 MBJupyter NotebookJupyter Notebook: 54.6 MB54.6 MBPythonPython: 19.4 MB19.4 MBJavaScriptJavaScript: 10.9 MB10.9 MBCSSCSS: 7.1 MB7.1 MBSCSSSCSS: 1.8 MB1.8 MBMakefileMakefile: 728.4 kB728.4 kBTypeScriptTypeScript: 531.8 kB531.8 kBNunjucksNunjucks: 464.5 kB464.5 kBSvelteSvelte: 285.9 kB285.9 kBJinjaJinja: 239.9 kB239.9 kBShellShell: 167.8 kB167.8 kBHCLHCL: 42.5 kB42.5 kBDockerfileDockerfile: 31.7 kB31.7 kB

By number of repositories

How many repositories name each language as their primary one. A better guide to what engineers actually work in.

PythonPython: 163163MakefileMakefile: 127127HTMLHTML: 110110JavaScriptJavaScript: 100100ShellShell: 6666SCSSSCSS: 4949CSSCSS: 4545DockerfileDockerfile: 4040ProcfileProcfile: 3232MakoMako: 2020NunjucksNunjucks: 1919JinjaJinja: 1616Jupyter NotebookJupyter Notebook: 88TypeScriptTypeScript: 55

Live estate versus archive

The same language ranking, split by whether the repository is still active. The shift is the clearest signal of technical direction in the whole dataset.

Active repositories

PythonPython: 4646JavaScriptJavaScript: 1919HTMLHTML: 2424MakefileMakefile: 1212CSSCSS: 44ShellShell: 55Jupyter NotebookJupyter Notebook: 55TypeScriptTypeScript: 33NunjucksNunjucks: 00HCLHCL: 00

Archived repositories

PythonPython: 5050JavaScriptJavaScript: 3434HTMLHTML: 1010MakefileMakefile: 2020CSSCSS: 77ShellShell: 33Jupyter NotebookJupyter Notebook: 11TypeScriptTypeScript: 00NunjucksNunjucks: 22HCLHCL: 22

Scale

Repository size distribution

Git data per repository, log-ish buckets.

685134170< 10 kB: 22< 10 kB< 100 kB: 54< 100 kB< 1 MB: 68< 1 MB< 10 MB: 59< 10 MB< 100 MB: 50< 100 MB100 MB +: 28100 MB +

Commits against files

Each circle is a repository, sized by number of distinct authors. Both axes are logarithmic. The diagonal band is the normal relationship between codebase size and churn; outliers above it are long-lived apps with heavy iteration, below it are dumps and imports.

5.4k939.2164.028.65.0224.3296.43.6k43.9k.github: 13 commits, 3 files, 3 authorsPublishExamples: 59 commits, 56 files, 8 authorsQGIS: 19 commits, 13 files, 2 authorsabout--node-build: 14 commits, 16 files, 2 authorsaddressbase-datasette: 20 commits, 9 files, 2 authorsaddressbase-duckdb: 11 commits, 10 files, 1 authorsairflow-dags: 796 commits, 40 files, 30 authorsalpha-data: 98 commits, 50 files, 11 authorsancient-woodland: 178 commits, 43,918 files, 3 authorsapp-template: 7 commits, 36 files, 2 authorsarchived-design-history: 283 commits, 96 files, 7 authorsarea-of-outstanding-natural-beauty: 187 commits, 40 files, 3 authorsarea-of-outstanding-natural-beauty-collection: 1,417 commits, 16 files, 8 authorsarticle-4-direction: 259 commits, 72 files, 4 authorsarticle-4-direction-collection: 1,843 commits, 39 files, 28 authorsasync-request-backend: 689 commits, 140 files, 28 authorsaws-batch-docker: 13 commits, 5 files, 2 authorsbarnet-conservation-areas: 19 commits, 32 files, 1 authorsbattlefield: 179 commits, 53 files, 3 authorsbrownfield-land: 341 commits, 28,818 files, 5 authorsbrownfield-land-screenshots: 9 commits, 2,809 files, 1 authorsbrownfield-resources: 312 commits, 55 files, 9 authorsbrownfield-site: 287 commits, 2,639 files, 3 authorsbrownfield-sites-status: 105 commits, 493 files, 3 authorsbrownfield-sites-validator: 476 commits, 1,116 files, 6 authorsbuilding-preservation-notice: 177 commits, 10 files, 3 authorscentral-activities-zone-collection: 1,104 commits, 13 files, 9 authorscertificate-of-immunity: 176 commits, 205 files, 3 authorscheck-brownfield-land-data: 92 commits, 75 files, 5 authorscheck-data-prototype: 49 commits, 66 files, 2 authorschoropleth: 21 commits, 17 files, 1 authorscms: 9 commits, 10 files, 1 authorscollection: 301 commits, 203 files, 5 authorscollection-datastore: 50 commits, 24 files, 2 authorscollection-task: 296 commits, 39 files, 17 authorscollection-template: 136 commits, 25 files, 17 authorscommunity-infrastructure-levy-data: 7 commits, 2 files, 2 authorsconfig: 5,379 commits, 923 files, 53 authorsconfig-manager: 1,061 commits, 198 files, 35 authorsconservation-area: 410 commits, 8,825 files, 5 authorsconservation-area-collection: 2,227 commits, 26 files, 31 authorsconservation-area-data: 67 commits, 695 files, 6 authorsconsiderations-obsidian: 9 commits, 1,381 files, 1 authorsconsumers-design-history: 14 commits, 41 files, 4 authorscontent-frontend: 66 commits, 36 files, 5 authorscontent-site: 162 commits, 101 files, 5 authorscontribution-funding-status: 262 commits, 11 files, 4 authorscontribution-purpose: 274 commits, 28 files, 4 authorscookies--node-build: 12 commits, 12 files, 2 authorscopyright--node-build: 14 commits, 23 files, 2 authorscpos-prototype: 199 commits, 486 files, 4 authorsdata-analyser: 23 commits, 87 files, 1 authorsdata-api: 5 commits, 11 files, 2 authorsdata-collector: 14 commits, 17 files, 1 authorsdata-design-design-history: 13 commits, 41 files, 3 authorsdata-fixer-prototype: 17 commits, 9 files, 2 authorsdata-package-builder-task: 41 commits, 14 files, 8 authorsdata-playback-prototype: 8 commits, 110 files, 1 authorsdata-standards: 1,325 commits, 1,478 files, 15 authorsdatasette: 3,486 commits, 210 files, 92 authorsdatasette-builder: 347 commits, 24 files, 20 authorsdatasette-digital-land: 59 commits, 25 files, 5 authorsdesign-code-collection: 739 commits, 30 files, 9 authorsdesign-code-explorer: 115 commits, 104 files, 3 authorsdesign-system: 631 commits, 313 files, 7 authorsdesign-work: 31 commits, 100 files, 1 authorsdesign.digital-land.info: 278 commits, 267 files, 9 authorsdeveloper-agreement: 280 commits, 13 files, 5 authorsdeveloper-agreement-contribution: 275 commits, 13 files, 5 authorsdeveloper-agreement-transaction: 276 commits, 13 files, 5 authorsdeveloper-agreement-type: 265 commits, 9 files, 5 authorsdeveloper-contribution-purpose-page: 15 commits, 8 files, 3 authorsdevelopment-plan-document: 307 commits, 278 files, 6 authorsdevelopment-plan-timetable-prototype: 224 commits, 116 files, 5 authorsdevelopment-plan-type: 272 commits, 26 files, 5 authorsdevelopment-policy: 312 commits, 983 files, 6 authorsdevelopment-policy-area: 290 commits, 241 files, 6 authorsdevelopment-policy-category: 266 commits, 113 files, 4 authorsdigital-land: 1,707 commits, 32 files, 27 authorsdigital-land-airflow: 149 commits, 104 files, 2 authorsdigital-land-application: 55 commits, 98 files, 2 authorsdigital-land-archived: 1,719 commits, 595 files, 18 authorsdigital-land-builder: 454 commits, 47 files, 24 authorsdigital-land-builder-task: 66 commits, 44 files, 9 authorsdigital-land-data: 38 commits, 734 files, 3 authorsdigital-land-datasette: 100 commits, 25 files, 6 authorsdigital-land-docker-pipeline-runner: 18 commits, 10 files, 2 authorsdigital-land-efs-sync: 56 commits, 17 files, 8 authorsdigital-land-frontend: 276 commits, 205 files, 13 authorsdigital-land-frontend-heroku: 444 commits, 576 files, 6 authorsdigital-land-gcloud-shell-pipeline-runner: 23 commits, 8 files, 3 authorsdigital-land-lambda: 214 commits, 18 files, 10 authorsdigital-land-postgres: 234 commits, 49 files, 25 authorsdigital-land-python: 3,669 commits, 530 files, 80 authorsdigital-land-status: 90 commits, 9 files, 5 authorsdigital-land.github.io: 1,016 commits, 829 files, 25 authorsdigital-land.info: 3,343 commits, 415 files, 72 authorsdigital-planning-ways-of-working: 6 commits, 72 files, 2 authorsdl-batch-dashboard: 8 commits, 20 files, 2 authorsdl-website-screenshot-tool: 18 commits, 8 files, 1 authorsdluhc-datasets: 935 commits, 138 files, 25 authorsdluhc-interaction-patterns: 27 commits, 54 files, 2 authorsdocument: 220 commits, 482 files, 3 authorsdocument-collection: 958 commits, 852 files, 8 authorsdocument-type: 212 commits, 13 files, 4 authorsdocumentation-url-examples: 54 commits, 20 files, 4 authorsdownload-lambda: 86 commits, 62 files, 7 authorsecosystem-diagram: 27 commits, 8 files, 2 authorsemployment-allocation: 148 commits, 24 files, 4 authorsendpoint-submission-form: 1,145 commits, 51 files, 11 authorsengagement-platform: 10 commits, 6 files, 3 authorsengagement-platform-cms: 28 commits, 58 files, 5 authorsengagement-platform-webapp: 101 commits, 69 files, 6 authorsentity-builder: 111 commits, 18 files, 11 authorsentity-end-date-data: 17 commits, 10 files, 4 authorsentity-service-spike: 7 commits, 7 files, 2 authorsextract-alpha: 157 commits, 172 files, 14 authorsfeedback-prototype: 99 commits, 70 files, 2 authorsfile-manager: 20 commits, 12 files, 1 authorsform-generator: 95 commits, 104 files, 2 authorsfriction--node-build: 6 commits, 35 files, 2 authorsfrontend: 621 commits, 212 files, 7 authorsgeography: 6 commits, 12 files, 1 authorsgithub-action-slack-notify-build: 120 commits, 22 files, 6 authorsgithub-build-checker: 7 commits, 5 files, 2 authorsgovuk-frontend-jinja: 314 commits, 61 files, 12 authorsgovuk-jinja-components: 46 commits, 74 files, 6 authorsgovuk-prototype-kit-codespaces: 20 commits, 16 files, 1 authorsgreen-belt: 175 commits, 200 files, 3 authorsgreen-box-data-quality: 21 commits, 13 files, 2 authorsguidance: 130 commits, 66 files, 7 authorsguidance-archived: 21 commits, 10 files, 2 authorshelm-charts: 31 commits, 17 files, 5 authorsheritage-at-risk: 172 commits, 5,029 files, 4 authorsheritage-coast: 189 commits, 38 files, 3 authorshistoric-england-collection: 905 commits, 14 files, 10 authorshousing-allocation: 157 commits, 135 files, 3 authorshugo-replacement: 33 commits, 305 files, 2 authorsinfrastructure-funding-statement: 274 commits, 87 files, 4 authorsinfrastructure-funding-statement-collection: 1,567 commits, 15 files, 17 authorsinfrastructure-funding-statement-prototype: 25 commits, 143 files, 3 authorsinfrastructure-project-collection: 229 commits, 24 files, 11 authorsissues-datasette: 10 commits, 22 files, 2 authorsjupyter-analysis: 485 commits, 268 files, 29 authorsland-calculator: 45 commits, 52 files, 1 authorsland-use-calculator: 355 commits, 3,012 files, 5 authorslandregistry-index-data: 5 commits, 95 files, 1 authorsleaflet-spike: 26 commits, 5 files, 2 authorslicence--node-build: 5 commits, 23 files, 2 authorslightning-map: 12 commits, 17 files, 1 authorslink-check: 7 commits, 4 files, 1 authorslisted-building: 9 commits, 19,735 files, 3 authorslisted-building-grade: 166 commits, 9 files, 3 authorslocal-area-requirements-collection: 25 commits, 12 files, 7 authorslocal-authority-addresses: 44 commits, 22 files, 2 authorslocal-authority-district: 278 commits, 323 files, 5 authorslocal-plan: 346 commits, 442 files, 5 authorslocal-plan-extractor: 343 commits, 2,839 files, 6 authorslocal-plans-alpha: 87 commits, 160 files, 4 authorslocal-plans-consultations-email-automation: 5 commits, 6 files, 1 authorslocal-plans-explorer: 386 commits, 170 files, 17 authorslocal-plans-home: 180 commits, 155 files, 8 authorslocal-plans-prototype: 659 commits, 527 files, 11 authorslocal-plans-timetable: 718 commits, 114 files, 12 authorsmakerules: 527 commits, 11 files, 26 authorsmanage-planning-data-prototype: 6 commits, 46 files, 1 authorsmap: 324 commits, 22 files, 5 authorsmap-archived: 330 commits, 364 files, 4 authorsmap-templates: 125 commits, 875 files, 6 authorsmaplibre-spike: 23 commits, 26 files, 2 authorsmarkdown-content-template: 11 commits, 23 files, 3 authorsmini-cms: 101 commits, 52 files, 3 authorsmini-cms-data: 118 commits, 30 files, 3 authorsmwaa-authx-lambda: 32 commits, 7 files, 4 authorsneeds--node-build: 7 commits, 29 files, 2 authorsnotify-upload: 48 commits, 13 files, 4 authorsorganisation-dataset: 350 commits, 73 files, 8 authorsorganisation-workflow: 6 commits, 17 files, 2 authorsownership-status: 248 commits, 9 files, 4 authorsparish: 52 commits, 20,950 files, 6 authorspark-and-garden: 178 commits, 1,705 files, 3 authorspark-and-garden-grade: 163 commits, 10 files, 3 authorsperformance: 225 commits, 436 files, 1 authorsperformance-api: 7 commits, 2 files, 2 authorspermitted-development-right: 286 commits, 154 files, 5 authorspipeline-internal-api: 95 commits, 726 files, 7 authorspipeline-runner-api: 123 commits, 52 files, 11 authorsplan-making: 518 commits, 116 files, 18 authorsplanning-application-data-specification: 1,851 commits, 2,913 files, 10 authorsplanning-application-poc: 42 commits, 63 files, 2 authorsplanning-condition-data: 11 commits, 8 files, 3 authorsplanning-data-analysis: 24 commits, 81 files, 4 authorsplanning-data-design: 1,117 commits, 182 files, 22 authorsplanning-data-flow: 16 commits, 50 files, 1 authorsplanning-data-prototype: 145 commits, 59 files, 7 authorsplanning-game: 50 commits, 21 files, 3 authorsplanning-permission-status: 249 commits, 9 files, 4 authorsplanning-permission-type: 260 commits, 13 files, 4 authorspostgres-database-provisioner: 15 commits, 9 files, 3 authorsproduct: 29 commits, 45 files, 4 authorsproject-kanban-cards: 5 commits, 4 files, 1 authorsprotected-wreck-site: 178 commits, 60 files, 3 authorsprovide-planning-data-design-history: 14 commits, 163 files, 3 authorsprovider-design-sprint: 336 commits, 213 files, 11 authorsprovider-team-design-files: 13 commits, 237 files, 1 authorspublish-planning-data-prototype: 85 commits, 47 files, 3 authorspyspark-jobs: 922 commits, 123 files, 17 authorsquality-challenge: 129 commits, 42 files, 8 authorsquickstart: 27 commits, 9 files, 6 authorsramsar-collection: 1,369 commits, 16 files, 10 authorsregister-editing-tool: 17 commits, 120 files, 4 authorsrender-template: 18 commits, 11 files, 5 authorsreporting-task: 92 commits, 33 files, 6 authorsrepositories-dashboard: 18 commits, 25 files, 4 authorsripa_expectation_yamls: 6 commits, 114 files, 2 authorsroadmap: 61 commits, 20 files, 3 authorsscheduled-monument: 178 commits, 19,935 files, 3 authorssection-106-prototype: 276 commits, 570 files, 6 authorsservice: 32 commits, 45 files, 4 authorsservice-handbook: 120 commits, 56 files, 11 authorsservice-status: 925 commits, 25 files, 8 authorssite-category: 197 commits, 8 files, 3 authorssite-of-special-scientific-interest: 181 commits, 4,149 files, 3 authorsslug-index: 8 commits, 9 files, 2 authorssmoke-test: 43 commits, 9 files, 4 authorsspecial-area-of-conservation: 178 commits, 1,913 files, 3 authorsspecification: 4,013 commits, 2,026 files, 57 authorsstandards-manager: 83 commits, 129 files, 6 authorsstandards-manual: 45 commits, 36 files, 3 authorssubmit: 4,274 commits, 442 files, 38 authorssynthetics-canary-local-debugging-sample: 6 commits, 690 files, 3 authorstechnical-documentation: 770 commits, 213 files, 52 authorstiles-builder: 164 commits, 36 files, 20 authorstiles-builder-task: 129 commits, 12 files, 18 authorstools: 6 commits, 3 files, 1 authorstree-preservation-order: 12 commits, 313 files, 3 authorsvalidator: 88 commits, 47 files, 4 authorsvalidator-serverless: 10 commits, 15 files, 2 authorsvalidators: 50 commits, 23 files, 6 authorsvector-tiles-spike: 7 commits, 8 files, 1 authorsvibe-planning: 65 commits, 63 files, 3 authorsview-builder: 94 commits, 24 files, 3 authorsworld-heritage-site: 179 commits, 26 files, 3 authorsfiles at HEAD (log)commits (log)

The shape of a repository

Directory layout is the cheapest reliable signal of what a repository actually is. app/ with config/ and spec/ is a Rails application; src/ with test/ is Java or Node. Counted by how many repositories contain each top-level directory at HEAD.

Most common top-level directories

docsdocs: 108108srcsrc: 4747datadata: 4646binbin: 4444teststests: 4444makerulesmakerules: 3737applicationapplication: 3434templatestemplates: 3333contentcontent: 3232requirementsrequirements: 3030configconfig: 2828appapp: 2020migrationsmigrations: 1919scriptsscripts: 1818assetsassets: 1313pipelinepipeline: 1111datasetdataset: 1111.vscode.vscode: 99

Most common file extensions

By total file count across the estate.

.pbf.pbf: 166.8k166.8k.html.html: 150.8k150.8k.geojson.geojson: 20.7k20.7k.md.md: 5.1k5.1k.png.png: 3.4k3.4k.json.json: 3.3k3.3k.csv.csv: 3.1k3.1k.py.py: 2.8k2.8k.js.js: 1.7k1.7k.bin.bin: 1.5k1.5k.scss.scss: 1.4k1.4k.svg.svg: 1.1k1.1k.njk.njk: 851851.tif.tif: 784784.parquet.parquet: 696696.pdf.pdf: 481481

The twenty largest repositories

RepositoryLanguageGit size CommitsFilesStatus
brownfield-landPython6.5 GB34128,818archived
local-plan-extractorPython4.8 GB3432,839active
ancient-woodlandPython2.4 GB17843,918archived
scheduled-monumentPython1.8 GB17819,935archived
conservation-areaPython1.2 GB4108,825archived
site-of-special-scientific-interestPython948.8 MB1814,149archived
landregistry-index-dataMakefile636.4 MB595archived
special-area-of-conservationPython580.0 MB1781,913archived
heritage-at-riskPython513.6 MB1725,029archived
parishMakefile482.3 MB5220,950active
brownfield-land-screenshotsHTML382.4 MB92,809archived
brownfield-sitePython370.5 MB2872,639archived
land-use-calculatorSvelte353.0 MB3553,012active
green-beltPython352.2 MB175200archived
conservation-area-collectionMakefile319.4 MB2,22726archived
park-and-gardenPython308.0 MB1781,705archived
developer-agreement-contributionMakefile261.7 MB27513archived
developer-agreement-transactionMakefile248.2 MB27613archived
map-templatesJavaScript217.0 MB125875archived
area-of-outstanding-natural-beautyPython211.8 MB18740archived