Julian de Hoog

Datasets

 

A list of free, openly available datasets (though some are for academic use only and/or require registration).

A separate list is also maintained by Oliver Parsons, here.   There are some datasets on there that I haven't yet added here.

 

Energy / Internet-of-Things

  • Dataport from Pecan Street - LINK
    "... a vast database of original and curated data that ranges from utility market operations to appliance-level consumer behavioral research" - free for academic use
  • TU Vienna ADRES dataset - LINK
    "a dataset of high resolution electric power and voltage profiles of Austrian households" - available for non-commercial use
  • EPRI Distributed PV Monitoring and Feeder Analysis - LINK
    "The distributed PV monitoring datasets are available for free and can be used by anyone."
  • UMass SMART dataset - LINK
    "...a wide variety of data collected from three real homes, including electrical (usage and generation), environmental (e.g., temperature and humidity), and operational (e.g., wall switch events). Also available is minute-level electricity usage data from 400+ anonymous homes."
  • Carnegie Mellon BLUED dataset - LINK
    "... voltage and current measurements for a single family residence in the United States, sampled at 12 kHz for a whole week. Every state transition of each appliance in the home during this time was labeled and time-stamped, providing the necessary ground truth for the evaluation of event-based algorithms."
  • MIT REDD dataset - LINK
    "... several weeks of power data for 6 different homes, and high-frequency current/voltage data for the main power supply of two of these homes"
  • AMPds - the Almanac of Minutely Power dataset - LINK
    "contains electricity, water, and natural gas measurements at one minute intervals — a total of 1,051,200 readings per meter for 2 years of monitoring"
  • UK Domestic Appliance-Level Electricity (UK DALE) dataset - LINK
    "This dataset records the power demand from five houses. In each house we record both the whole-house mains power demand every six seconds as well as power demand from individual appliances every six seconds. In three of the five houses (houses 1, 2 and 5) we also record the whole-house voltage and current at 16 kHz."
  • NEEA Regional Data Sources - LINK
    Among other things, "RBSA metering data is comprised of end-use loads measured at 15-minute intervals over 27 consecutive months."
  • UCI Individual household electric power consumption dataset - LINK
    "Measurements of electric power consumption in one household with a one-minute sampling rate over a period of almost 4 years. Different electrical quantities and some sub-metering values are available."
  • IEEE PES Intelligent Systems Applications Subcommittee datasets - LINK
    A wide range of weather and energy - related datasets at resolutions as high as 10-seconds
  • Low Carbon London Project : Electricity data - LINK
    "meter reading and consumer survey data from the UK's first residential sector, dynamic time-of-use electricity pricing trial, which took place as part of the Low Carbon London (LCL) project" ...
    "30-minute smart meter readings for 5000+ customers in London, 1000+ of which had opted in to a dynamic time of use tariff"
  • Ausgrid Solar Home Electricity Data - LINK
    "The half-hour electricity data is for 300 homes with rooftop solar systems that are measured by a gross meter that records the total amount of solar power generated every 30 minutes.  The monthly electricity data is for 2,657 solar homes with rooftop solar systems that have a gross metering configuration."


Weather

  • NREL National Solar Radiation Database - LINK
    "The National Solar Radiation Database (NSRDB) is a serially complete collection of meteorological and solar irradiance data sets for the United States and a growing list of international locations. The data are publicly available at no cost to the user."
  • NREL National Wind Technology Centre M2 Tower - LINK
  • IRENA Renewable Resource Data - LINK
    "a complete suite of services to support renewable resource mapping and assessment, including an online GIS interface, datasets for five renewable energy technologies that cover every country in the world, online analysis tools, and the ability to export data and maps in several different formats."