← all organisations

NaturalHistoryMuseum / Code

54 languages, 173.3 MB of source, and what the live estate is written in today.

Language figures come from GitHub's own per-repository byte counts, which measure source rather than a single headline label. File counts and repository sizes come from the mirrors themselves. The two tell different stories, and the difference is the point.

The codebase

54
languages in use
173.3 MB of source
237.9k
files at HEAD
across every analysed repository
0 B
on disk as mirrors
full history, every branch and tag
1.8 GB
largest repository
ALICE

What stands out

One archived repository holds 24% of all the bytes.

ALICE is 1.8 GB of git - a 2013 static snapshot of www.gov.uk, not source code. It single-handedly makes HTML the largest language by volume (4% of all source bytes). Any size or language statistic that does not exclude it is measuring an archive, not a codebase.

Sizes here are GitHub's reported figures.

This organisation was harvested with blobless partial clones, which fetch every commit and file path but not file contents, so there is no local size to measure against. Checked elsewhere in this dataset against 1,526 fully mirrored repositories, GitHub's reported size is accurate to within about six percent.

Ruby is the house language, but its share is falling.

Ruby is the primary language of 0% of archived repositories but only 2% of live ones. Python, Go, TypeScript and HCL have taken the difference - the signature of a shift from monolithic Rails publishing apps toward data pipelines, infrastructure-as-code and platform tooling.

Most repositories are small; a handful are enormous.

57% of repositories are under a megabyte of git data. The estate is not a monolith - it is a very long tail of small services, gems and prototypes around a few large publishing applications.

Languages, two ways

By volume of source

Bytes of code. Dominated by archived static HTML.

PHPPHP: 52.9 MB52.9 MBJupyter NotebookJupyter Notebook: 51.8 MB51.8 MBPythonPython: 18.8 MB18.8 MBJavaScriptJavaScript: 15.6 MB15.6 MBRubyRuby: 8.3 MB8.3 MBHTMLHTML: 7.4 MB7.4 MBCSSCSS: 6.6 MB6.6 MBVueVue: 2.8 MB2.8 MBCC: 2.0 MB2.0 MBC#C#: 1.1 MB1.1 MBActionScriptActionScript: 958.1 kB958.1 kBGoGo: 936.2 kB936.2 kBSQLPLSQLPL: 774.8 kB774.8 kBTypeScriptTypeScript: 592.0 kB592.0 kB

By number of repositories

How many repositories name each language as their primary one. A better guide to what engineers actually work in.

PythonPython: 100100JavaScriptJavaScript: 5656HTMLHTML: 5252ShellShell: 4646DockerfileDockerfile: 3838CSSCSS: 3434Jupyter NotebookJupyter Notebook: 1818PHPPHP: 1414VueVue: 1313LessLess: 1313MakefileMakefile: 1212RubyRuby: 1010RR: 99SCSSSCSS: 99

Live estate versus archive

The same language ranking, split by whether the repository is still active. The shift is the clearest signal of technical direction in the whole dataset.

Active repositories

PythonPython: 6363Jupyter NotebookJupyter Notebook: 1414JavaScriptJavaScript: 1313PHPPHP: 1111VueVue: 77RR: 66CC: 55CSSCSS: 55ShellShell: 44HTMLHTML: 44

Archived repositories

PythonPython: 1010Jupyter NotebookJupyter Notebook: 00JavaScriptJavaScript: 11PHPPHP: 00VueVue: 00RR: 00CC: 00CSSCSS: 00ShellShell: 00HTMLHTML: 00

Scale

Repository size distribution

Git data per repository, log-ish buckets.

6649.53316.50< 10 kB: 15< 10 kB< 100 kB: 28< 100 kB< 1 MB: 66< 1 MB< 10 MB: 31< 10 MB< 100 MB: 36< 100 MB100 MB +: 14100 MB +

Commits against files

Each circle is a repository, sized by number of distinct authors. Both axes are logarithmic. The diagonal band is the normal relationship between codebase size and churn; outliers above it are long-lived apps with heavy iteration, below it are dumps and imports.

26.3k3.1k362.942.65.0120.2407.28.2k165.8kADEPT: 297 commits, 110 files, 2 authorsALICE: 142 commits, 94 files, 8 authorsCliffordHerbarium-imgs: 7 commits, 3,461 files, 2 authorsDEAN-PHD-TEXT-COLLECTOR: 13 commits, 22 files, 2 authorsDM-ScienceUncoveredImages: 13 commits, 1,056 files, 1 authorsDM-ScienceUncoveredImages2: 11 commits, 986 files, 1 authorsDMM_Development_Team_Principles: 8 commits, 1 files, 5 authorsDataPortalStats: 13 commits, 14 files, 2 authorsGERTIE: 6 commits, 79 files, 1 authorsGERTIE-DEV: 143 commits, 129 files, 2 authorsIDentiBite: 153 commits, 292 files, 2 authorsKEParser: 27 commits, 9 files, 5 authorsLeafMachine2: 133 commits, 1,063 files, 4 authorsLichensOnTwigsImages: 7 commits, 148 files, 1 authorsLudlowMuseumImgs: 7 commits, 1,379 files, 1 authorsMobilising-Collections-Biodiversity-Data: 40 commits, 5 files, 4 authorsNHM-IB: 21 commits, 8 files, 4 authorsPKB: 34 commits, 29 files, 3 authorsUNPdummy: 7 commits, 14 files, 1 authorsZBarWin64: 382 commits, 408 files, 11 authorsai-natural-sciences: 37 commits, 20 files, 1 authorsalkcarb: 10 commits, 5 files, 3 authorsannette: 237 commits, 91 files, 6 authorsansible-ckanpackager: 6 commits, 13 files, 2 authorsaudioblast_ingest: 195 commits, 9 files, 2 authorsbig-splash: 7 commits, 5 files, 2 authorsbiodiversity-informatics-101: 58 commits, 7 files, 1 authorscalcid-transcriptions: 25 commits, 30 files, 1 authorsckan: 26,334 commits, 2,132 files, 477 authorsckanext-attribution: 281 commits, 144 files, 7 authorsckanext-ckanpackager: 202 commits, 38 files, 10 authorsckanext-contact: 257 commits, 56 files, 17 authorsckanext-datasolr: 95 commits, 20 files, 7 authorsckanext-dataspatial: 20 commits, 26 files, 4 authorsckanext-dcat: 515 commits, 67 files, 34 authorsckanext-dev: 7 commits, 9 files, 3 authorsckanext-doi: 374 commits, 68 files, 19 authorsckanext-feedback: 39 commits, 15 files, 4 authorsckanext-gallery: 252 commits, 102 files, 14 authorsckanext-gbif: 224 commits, 54 files, 10 authorsckanext-graph: 160 commits, 55 files, 10 authorsckanext-iiif: 167 commits, 61 files, 7 authorsckanext-ldap: 369 commits, 61 files, 37 authorsckanext-list: 148 commits, 51 files, 9 authorsckanext-map: 233 commits, 111 files, 10 authorsckanext-nhm: 2,826 commits, 2,126 files, 27 authorsckanext-query-dois: 264 commits, 74 files, 9 authorsckanext-sketchfab: 110 commits, 44 files, 7 authorsckanext-solr-heatmap: 20 commits, 46 files, 6 authorsckanext-spatial: 755 commits, 526 files, 35 authorsckanext-statistics: 302 commits, 57 files, 12 authorsckanext-status: 139 commits, 52 files, 8 authorsckanext-twitter: 133 commits, 56 files, 7 authorsckanext-userdatasets: 149 commits, 52 files, 10 authorsckanext-versioned-datastore: 1,194 commits, 239 files, 10 authorsckanext-versioned-tiledmap: 378 commits, 97 files, 13 authorsckanext-video: 123 commits, 44 files, 9 authorsckanext-webview: 98 commits, 44 files, 7 authorsckanpackager: 152 commits, 53 files, 9 authorsckantest: 31 commits, 15 files, 1 authorsckantools: 104 commits, 41 files, 5 authorscompile-frontend-actions: 67 commits, 1,626 files, 4 authorscookiecutter-ckanext: 99 commits, 47 files, 4 authorscv-leaf-traits: 5 commits, 5 files, 1 authorscz-nhm: 42 commits, 9 files, 5 authorsdaily-stats: 147 commits, 28 files, 6 authorsdata-importer: 538 commits, 98 files, 13 authorsdata-portal-deployment: 16 commits, 10 files, 2 authorsdata-portal-feedback: 1,190 commits, 796 files, 43 authorsdata-portal-google-scripts-lib: 53 commits, 11 files, 1 authorsdataportal-docs: 556 commits, 45 files, 118 authorsdataportal-import-provision: 34 commits, 8 files, 2 authorsdataportal-server-provision: 73 commits, 19 files, 5 authorsdataportal_monitor: 10 commits, 23 files, 2 authorsdataportal_test_runner: 18 commits, 26 files, 4 authorsdemo-enrichment-service-image: 163 commits, 62 files, 8 authorsdmtx-wrappers: 1,181 commits, 78 files, 5 authorsdurden: 10 commits, 4 files, 1 authorsegg_cards: 40 commits, 18 files, 2 authorsextensions.ckan.org: 220 commits, 258 files, 13 authorsfencedine: 24 commits, 2 files, 1 authorsflickr-slideshow: 13 commits, 5 files, 2 authorsgamc: 25 commits, 27 files, 2 authorsgarden-science-papers: 7 commits, 2 files, 1 authorsgbif-name-resolution: 5 commits, 5 files, 1 authorsgouda: 157 commits, 65 files, 2 authorshosting_auto_pack: 13 commits, 5 files, 4 authorshosting_scratchpads: 74 commits, 11 files, 8 authorsiiif-image-server: 338 commits, 63 files, 8 authorsinselect: 1,250 commits, 286 files, 14 authorsinselect-SPNHC2016: 28 commits, 35 files, 1 authorsinselect-templates: 16 commits, 11 files, 1 authorsjoin-the-dots: 8 commits, 6 files, 1 authorsjoin-the-dots-dev: 442 commits, 197 files, 10 authorsjsc3d: 199 commits, 19 files, 5 authorske2mongo: 457 commits, 76 files, 6 authorslates-may-23: 31 commits, 77 files, 7 authorsleventis: 44 commits, 40 files, 3 authorslibdig-task: 7 commits, 7 files, 2 authorslibdmtx-windows: 1,286 commits, 246 files, 4 authorslicences: 8 commits, 3 files, 2 authorslinnaeus: 126 commits, 115 files, 4 authorsmali-traits: 12 commits, 6 files, 2 authorsmysql-slow: 20 commits, 8 files, 1 authorsnhm-docker-ckan: 21 commits, 13 files, 3 authorsnhm-informatics.github.io: 27 commits, 351 files, 2 authorsnhm-pyportal: 7 commits, 26 files, 2 authorsnhm-windshaft-app: 42 commits, 18 files, 4 authorsnhm-windshaft-chef: 18 commits, 11 files, 1 authorsnhm-windshaft-utils: 42 commits, 46 files, 1 authorspelican-themes: 780 commits, 1,468 files, 219 authorspeople-disambiguation: 21 commits, 45 files, 3 authorsphenome-10k: 516 commits, 292 files, 12 authorsphonegap-plugin-contentsync: 368 commits, 47 files, 22 authorsphthiraptera-transcription: 155 commits, 72 files, 4 authorspkb-ocr: 32 commits, 41 files, 3 authorsplanetary-knowledge-base: 27 commits, 7 files, 2 authorsplant-traits: 23 commits, 10,660 files, 5 authorsplant-traits-old: 13 commits, 165,842 files, 2 authorsplusmoin: 9 commits, 32 files, 1 authorsportal-search-ui: 53 commits, 44 files, 8 authorspredicts_www: 225 commits, 224 files, 10 authorspylibdmtx: 213 commits, 31 files, 32 authorspymids: 15 commits, 21 files, 2 authorspyzbar: 219 commits, 37 files, 30 authorsraster-project: 540 commits, 193 files, 6 authorsrecode-consultation: 14 commits, 2 files, 1 authorsretweet: 17 commits, 15 files, 1 authorsrevile: 13 commits, 18 files, 3 authorsriver-dolphin-convergence: 42 commits, 28 files, 2 authorsscratchpads: 3,872 commits, 7,021 files, 10 authorsscratchpads-cite: 10 commits, 14 files, 2 authorsscratchpads-evolution: 24 commits, 50 files, 3 authorsscratchpads.org: 275 commits, 378 files, 15 authorsscratchpads2: 19,258 commits, 12,179 files, 32 authorsscratchpads2-chef: 897 commits, 1,274 files, 5 authorsscratchpads2-docker: 115 commits, 31 files, 23 authorsscreenshots: 38 commits, 9 files, 1 authorssemantic-segmentation: 83 commits, 21 files, 4 authorssmhackdown: 20 commits, 23 files, 2 authorssmhackdown-api: 13 commits, 11 files, 2 authorssolanaceaesource-2.0: 46 commits, 14 files, 1 authorsspecimen-chat: 5 commits, 12 files, 2 authorssplitgill: 580 commits, 66 files, 8 authorsstats.scratchpads.eu: 9,397 commits, 481 files, 30 authorssu2013: 19 commits, 26 files, 2 authorssu2014: 159 commits, 38 files, 3 authorssynth_transform: 150 commits, 28 files, 3 authorssynthesys: 23 commits, 56 files, 3 authorssyrup: 16 commits, 20 files, 1 authorstaxonworks: 19,404 commits, 5,776 files, 42 authorstraits: 7 commits, 198 files, 1 authorsukbol: 204 commits, 90 files, 2 authorsuksi-importer: 9 commits, 8 files, 1 authorsunpdata: 17 commits, 11 files, 2 authorsvbrant.eu: 9,377 commits, 3,558 files, 28 authorsversioned-datastore-tile-server: 77 commits, 24 files, 5 authorsvertebrate-georef: 97 commits, 47 files, 2 authorsvision: 123 commits, 70 files, 4 authorszbar-python-patched: 10 commits, 26 files, 2 authorszoa: 387 commits, 91 files, 10 authorsfiles at HEAD (log)commits (log)

The shape of a repository

Directory layout is the cheapest reliable signal of what a repository actually is. app/ with config/ and spec/ is a Rails application; src/ with test/ is Java or Node. Counted by how many repositories contain each top-level directory at HEAD.

Most common top-level directories

teststests: 3636docsdocs: 3535ckanextckanext: 3030dockerdocker: 2828srcsrc: 1515binbin: 1111scriptsscripts: 1010datadata: 1010assetsassets: 88testtest: 77notebooksnotebooks: 77liblib: 77publicpublic: 66deploymentdeployment: 55buildbuild: 55miscmisc: 55examplesexamples: 55distdist: 55

Most common file extensions

By total file count across the estate.

.json.json: 176.8k176.8k.jpg.jpg: 13.1k13.1k.js.js: 5.2k5.2k.inc.inc: 4.2k4.2k.py.py: 3.5k3.5k.png.png: 3.3k3.3k.rb.rb: 3k3k.php.php: 2.7k2.7k.html.html: 2.5k2.5k.svg.svg: 1.8k1.8k.css.css: 1.7k1.7k.md.md: 1.5k1.5k.txt.txt: 1.3k1.3k.info.info: 1.2k1.2k.gif.gif: 1.2k1.2k.module.module: 1.1k1.1k

The twenty largest repositories

RepositoryLanguageGit size CommitsFilesStatus
ALICEJupyter Notebook1.8 GB14294active
scratchpads2PHP751.0 MB19,25812,179active
CliffordHerbarium-imgs-689.5 MB73,461active
SMALL_TAGGED_GEOREF-400.0 MB21,482active
IDentiBiteVue311.0 MB153292active
scratchpadsPHP294.2 MB3,8727,021active
HermannHerbarium-imgs-293.8 MB21,652active
LudlowMuseumImgs-246.8 MB71,379active
SloaneHerbarium-imgs-244.5 MB11,259active
linnaeusPython228.4 MB126115active
ADEPTPython172.5 MB297110active
ckanPython159.8 MB26,3342,132active
lates-may-23Python124.7 MB3177active
scratchpads.orgHTML118.1 MB275378active
ClaytonHerbarium-imgs-100.1 MB1722active
scratchpads2-chefRuby88.3 MB8971,274active
taxonworksRuby78.1 MB19,4045,776active
ckanext-nhmPython74.9 MB2,8262,126active
DM-ScienceUncoveredImages-72.6 MB131,056active
plant-traits-old-71.3 MB13165,842active