← all organisations

ONSBigData / Repo explorer

All 38 public alphagov repositories, filterable and sortable.

All 38 public repositories. Commits, authors and file counts come from the mirrored git history; type and team come from the GOV.UK Developer Documentation where it covers the repository. Type to filter; click a column heading to sort.

Repository Language Git size Commits Authors Files Type Team Status
exploring_companies_house
exploring and data checking companies house data read from pdfs
HTML565.7 MB513,249active
bristol_data_dive
Repo for work from the Bristol data dive: http://www.data4sdgs.org/news/bristol-data-dive
Jupyter Notebook187.9 MB111277active
OpencellID-analysis
Comparing densities of mobile cell towers with population estimates
R100.7 MB100133active
dcm-transcripts-new
Jupyter Notebook49.4 MB62386active
parsing_company_accounts
Reading digital XBRL/iXBRL account documents - for sharing
HTML41.5 MB481440active
traffic_as_early_indicator
Files for a brief report investigating if traffic flow (Annual average daily flow) could be used
HTML39.5 MB302136active
synthetic4linkage
Creating synthetic data for testing clerical linkage interface
Python26.8 MB97458active
ESSnet-WP7-UK-Case-Study
Explore how we might produce statistics on social sentiment from news/social media towards event
Python24.8 MB71220active
pycon-uk-2018
feedback from PyCon UK 2018
Jupyter Notebook12.5 MB26230active
RSS-2018
Traffic flow as an early indicator for GDP
HTML11.0 MB11268active
Measuring-Sustainability-Reporting
Measuring Sustainability Reporting using Web Scraping and Natural Language Processing
Python6.6 MB12114active
ONSBigData.github.io
The ONS Big Data Team Github pages
HTML5.2 MB1114221active
qbank-tools
Some useful code and tools for Question Bank project: script to convert JSON files to single cle
HTML4.3 MB992103active
LCF-project
Repository for the Big Data Team work on the LCF Project
Jupyter Notebook3.0 MB70532active
Clustering_paper
Working paper and notebook for unsupervised document clustering
Jupyter Notebook2.8 MB413active
bokeh_seed
Seed code for interactive visualisation tools based on Bokeh/Flask
Python2.5 MB14323active
EU-hackathon
Visualisation of training done by workers for EU Big Data Hackathon
R2.1 MB535active
labelpropagation_clothing
Code to accompany the Data and Policy and Ottawa group paper
HTML1.7 MB29517active
revealjs-demo
reveal.js demo slides
HTML1.6 MB17120active
dpm.dash
Packaged dashboard to facilitate fitting a dynamic population model (DPM) using accountTMB. Allo
R840.7 kB37636active
housing_clf
Classification of restricted access properties and caravans within Zoopla Data
Jupyter Notebook724.0 kB37410active
spark_udf_benchmark_example
Timed runs of Scala and Python UDFs in Spark (on a Virtual Machine).
Python629.8 kB2114active
ONS_Twitter
Repository for work carried out by the ONS on Twitter data.
Python557.1 kB216443active
ExtracTED
Scripts to extract and parse TED (Tenders Electronic Daily: http://ted.europa.eu/TED/main/HomePa
Python461.8 kB41117active
precon
Functions for price index economics.
Python367.6 kB329874active CI
companies_house_ocr_runner
Runs Tesseract OCR over PDF paper filings from Companies House.
Python334.8 kB25335active
drift_detection_model_retraining
Drift detection and model retraining methods
Jupyter Notebook263.2 kB513active
Who-you-work-with
An interactive visualisation for relationships between ONS Methodology and its stakeholders
JavaScript159.7 kB1218active
rise-presentation
Small self-contained RISE presentation example
Jupyter Notebook144.4 kB12212active
Scraping-demo
Web scraping demo files
Jupyter Notebook115.7 kB615active
scikit-learn-imputer
Imputation tool for categorical and continuous data using scikit-learn algorithms. Includes simu
Python98.3 kB32710active
MSc-course
Smart meter data and code for MSc course
R30.7 kB326active
zip_to_sequence_file
Command line utility to convert zip archives into Hadoop Sequence Files
Scala30.7 kB21114active
companies_house_filing_fetcher
Downloads paper filings from the Companies House API
Python24.6 kB22323active
textanalysisGUI
Python web GUI for text analysis purposes.
Python17.4 kB434active
scala_udf_example
Using Scala to create a Spark UDF designed to be callable from PySpark.
Scala13.3 kB328active
housing-websites
Collect data from Zoopla then use machine learning to identify caravans
Python11.3 kB636active
dsc-lunch
slides for dsc lunch
HTML0 B4146active