← all organisations

moj-analytical-services / Code

14 languages, 5.2 MB of source, and what the live estate is written in today.

Language figures come from GitHub's own per-repository byte counts, which measure source rather than a single headline label. File counts and repository sizes come from the mirrors themselves. The two tell different stories, and the difference is the point.

The codebase

14
languages in use
5.2 MB of source
1.6k
files at HEAD
across every analysed repository
0 B
on disk as mirrors
full history, every branch and tag
119.3 MB
largest repository
splink

What stands out

One archived repository holds 59% of all the bytes.

splink is 119.3 MB of git - a 2013 static snapshot of www.gov.uk, not source code. It single-handedly makes HTML the largest language by volume (1% of all source bytes). Any size or language statistic that does not exclude it is measuring an archive, not a codebase.

Sizes here are GitHub's reported figures.

This organisation was harvested with blobless partial clones, which fetch every commit and file path but not file contents, so there is no local size to measure against. Checked elsewhere in this dataset against 1,526 fully mirrored repositories, GitHub's reported size is accurate to within about six percent.

Ruby is the house language, but its share is falling.

Ruby is the primary language of 0% of archived repositories but only 0% of live ones. Python, Go, TypeScript and HCL have taken the difference - the signature of a shift from monolithic Rails publishing apps toward data pipelines, infrastructure-as-code and platform tooling.

Most repositories are small; a handful are enormous.

67% of repositories are under a megabyte of git data. The estate is not a monolith - it is a very long tail of small services, gems and prototypes around a few large publishing applications.

Languages, two ways

By volume of source

Bytes of code. Dominated by archived static HTML.

PythonPython: 3.6 MB3.6 MBJavaScriptJavaScript: 1.2 MB1.2 MBRR: 130.6 kB130.6 kBC++C++: 55.3 kB55.3 kBHTMLHTML: 50.8 kB50.8 kBShellShell: 37.8 kB37.8 kBJinjaJinja: 14.7 kB14.7 kBJupyter NotebookJupyter Notebook: 13.4 kB13.4 kBCSSCSS: 4.5 kB4.5 kBJavaJava: 3.4 kB3.4 kBDockerfileDockerfile: 2.4 kB2.4 kBMakefileMakefile: 2.0 kB2.0 kBCMakeCMake: 1.8 kB1.8 kBSCSSSCSS: 130 B130 B

By number of repositories

How many repositories name each language as their primary one. A better guide to what engineers actually work in.

PythonPython: 1010ShellShell: 55RR: 44MakefileMakefile: 33JavaScriptJavaScript: 22HTMLHTML: 22Jupyter NotebookJupyter Notebook: 11JinjaJinja: 11CSSCSS: 11DockerfileDockerfile: 11C++C++: 11JavaJava: 11CMakeCMake: 11SCSSSCSS: 11

Live estate versus archive

The same language ranking, split by whether the repository is still active. The shift is the clearest signal of technical direction in the whole dataset.

Active repositories

PythonPython: 88RR: 44C++C++: 11HTMLHTML: 11

Archived repositories

PythonPython: 11RR: 00C++C++: 00HTMLHTML: 00

Scale

Repository size distribution

Git data per repository, log-ish buckets.

64.531.50< 10 kB: 4< 10 kB< 100 kB: 4< 100 kB< 1 MB: 6< 1 MB< 10 MB: 4< 10 MB< 100 MB: 2< 100 MB100 MB +: 1100 MB +

Commits against files

Each circle is a repository, sized by number of distinct authors. Both axes are logarithmic. The diagonal band is the normal relationship between codebase size and churn; outliers above it are long-lived apps with heavy iteration, below it are dumps and imports.

12k1.7k244.635.05.028.133.2135.2551.0Rdbtools: 119 commits, 31 files, 10 authorsRs3tools: 120 commits, 33 files, 9 authorsactions-build-and-push-to-ecr: 53 commits, 3 files, 6 authorsactions-cross-account-ecr: 16 commits, 6 files, 4 authorsactions-lint-python: 15 commits, 2 files, 2 authorsactions-lint-yaml: 12 commits, 2 files, 2 authorsactions-mojap-package-depends: 53 commits, 5 files, 7 authorsactions-poetry-pypi-release: 10 commits, 5 files, 3 authorsdbtools: 149 commits, 42 files, 16 authorslaurium: 395 commits, 47 files, 12 authorsmetadata_schema: 38 commits, 13 files, 12 authorsmojchart: 49 commits, 54 files, 2 authorsopg-pipeline-builder: 556 commits, 90 files, 5 authorspydbtools: 553 commits, 52 files, 36 authorssplink: 11,965 commits, 551 files, 136 authorssplink_datasets: 5 commits, 13 files, 1 authorssplink_udfs: 174 commits, 43 files, 2 authorsuk_address_matcher: 1,707 commits, 238 files, 8 authorsukam_os_builder: 124 commits, 57 files, 7 authorsuser-guidance: 1,840 commits, 299 files, 156 authorsfiles at HEAD (log)commits (log)

The shape of a repository

Directory layout is the cheapest reliable signal of what a repository actually is. app/ with config/ and spec/ is a Rails application; src/ with test/ is Java or Node. Counted by how many repositories contain each top-level directory at HEAD.

Most common top-level directories

teststests: 99docsdocs: 66manman: 44RR: 44scriptsscripts: 44srcsrc: 33datadata: 22shellshell: 22renvrenv: 11instinst: 11docdoc: 11vignettesvignettes: 11notebooksnotebooks: 11mojap_metadatamojap_metadata: 11tabletable: 11data-rawdata-raw: 11pydbtoolspydbtools: 11splinksplink: 11

Most common file extensions

By total file count across the estate.

.py.py: 510510.md.md: 278278.png.png: 173173.erb.erb: 9797.json.json: 7575.rd.rd: 6161.yml.yml: 6161.csv.csv: 3434.r.r: 3333.gif.gif: 2727.sh.sh: 1717.yaml.yaml: 1616.html.html: 1313.ipynb.ipynb: 1313.parquet.parquet: 1313.txt.txt: 77

The twenty largest repositories

RepositoryLanguageGit size CommitsFilesStatus
splinkPython119.3 MB11,965551active
user-guidanceHTML48.4 MB1,840299active
uk_address_matcherPython21.7 MB1,707238active
splink_datasets-3.9 MB513active
pydbtoolsPython2.1 MB55352active
opg-pipeline-builderPython1.5 MB55690active
lauriumPython1.5 MB39547active
splink_udfsC++924.7 kB17443active
mojchartR695.3 kB4954active
dbtoolsR415.7 kB14942active
ukam_os_builderPython378.9 kB12457active
Rs3toolsR145.4 kB12033active
RdbtoolsR143.4 kB11931active
metadata_schema-39.9 kB3813active
actions-build-and-push-to-ecr-34.8 kB533active
actions-mojap-package-dependsPython33.8 kB535active
actions-cross-account-ecrPython19.5 kB166active
actions-lint-python-9.2 kB152archived
actions-poetry-pypi-release-8.2 kB105active
actions-lint-yaml-7.2 kB122archived