{"id":7243,"date":"2017-01-15T01:15:03","date_gmt":"2017-01-15T01:15:03","guid":{"rendered":"http:\/\/blog.soton.ac.uk\/serg\/?p=7243"},"modified":"2018-05-31T04:44:17","modified_gmt":"2018-05-31T04:44:17","slug":"a-most-unusual-sunday","status":"publish","type":"post","link":"https:\/\/blog.soton.ac.uk\/serg\/a-most-unusual-sunday\/","title":{"rendered":"A Most Unusual Sunday"},"content":{"rendered":"<p><strong>Author<\/strong>: <a href=\"https:\/\/www.southampton.ac.uk\/engineering\/about\/staff\/ba1e12.page?#research\">Ben Anderson<\/a> (<a href=\"mailto:b.anderson@soton.ac.uk\">b.anderson@soton.ac.uk<\/a>, <a href=\"https:\/\/twitter.com\/dataknut\">@dataknut<\/a>)<\/p>\n<p>There is often talk in the media about the &#8216;spikes&#8217; in energy demand caused by breaks in television schedules &#8211; when everyone is supposed to <a href=\"http:\/\/www.bbc.com\/news\/entertainment-arts-38414092\">jump up and put the kettle on<\/a> (or whatever). Although these make for good media stories, the largest overall surges are probably to do with cooking and secondary demands such as calls on <a href=\"https:\/\/www.theguardian.com\/environment\/2016\/dec\/23\/10-from-len-strictly-special-biggest-tv-power-spike-christmas\">industrial infrastructure<\/a> while increasing &#8216;on demand&#8217; and thus de-sychronised media consumption will mitigate the effects. That said, there doesn&#8217;t seem to be much evidence on what <em>actually<\/em> happens in households, partly because most <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0301421516307017#s0095\">measurement<\/a> takes place at levels in the electricity grid where household and industrial demand cannot be separated. So we thought we&#8217;d take a look.<\/p>\n<p><!--more-->This analysis uses a <a href=\"http:\/\/www.energy.soton.ac.uk\/save-data-sources\/\">stratified random sample of several thousand households<\/a> from the County of Hampshire, the Isle of Wight and the Cities of Southampton and Portsmouth who are taking part in a large-scale <a href=\"http:\/\/www.energy.soton.ac.uk\/tag\/save\/\">study<\/a> of energy demand. This sample is representative of these areas but possibly not of the wider UK population and we have been collecting 10 second power demand data from these households since late 2016.<\/p>\n<h2>Christmas Day 2016: Just another Sunday?<\/h2>\n<p>In order to compare household demand patterns for Christmas Day 2016 (a Sunday) with neighbouring Sundays we extracted and aggregated the 10 second power demand data to give mean kW demand over each 1 minute and 5 minute period for the Sundays before and after Christmas Day. This gives the plot shown below which also has 95% confidence intervals for the mean kW. These confidence intervals tell us several things, including how much variation there is at each time point.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-803\" src=\"https:\/\/dataknut.files.wordpress.com\/2017\/01\/allsundays_all1.png\" alt=\"allSundays_all.png\" width=\"1344\" height=\"1536\"><\/p>\n<p>As we can see, Christmas Day is definitely <strong>not<\/strong> just another Sunday. Demand is slightly higher in the early hours of the morning than on other Sundays &#8211; perhaps Santa Claus is leaving the lights on? In contrast to other Sundays, demand trends steadily upwards earlier in the morning with the predicted &#8216;<a href=\"https:\/\/www.theguardian.com\/environment\/2016\/dec\/23\/10-from-len-strictly-special-biggest-tv-power-spike-christmas\">cooking<\/a>&#8216; peak at around 13:00. It then falls away past the Queen&#8217;s Speech at 15:00 and on into a gentle evening at just the time that &#8216;normal&#8217; Sundays are ramping up.<\/p>\n<p>Interestingly New Year&#8217;s Day was <em>almost<\/em> just another Sunday but with some differences: demand from New Year&#8217;s Eve spilled over into the early hours and the usual breakfast surge was notably delayed by a couple of hours as we might expect.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-798\" src=\"https:\/\/dataknut.files.wordpress.com\/2017\/01\/allsundays_kids.png\" alt=\"allSundays_kids\" width=\"700\" height=\"432\"><\/p>\n<p>If we separate the plots out according to households with\/without children we see more or less the same picture. However, households with children have higher power demand (although they are also likely to have more people in them) and this is especially true on &#8216;normal&#8217; Sunday evenings. They appeared to go to bed slightly earlier on New Year&#8217;s Eve but get going rather later and have lower than normal demand on New Year&#8217;s Day evening compared to those without children. The latter appeared to party slightly later but be &#8216;back to normal&#8217; by the evening &#8211; perhaps because many would have been at work on the Monday.<\/p>\n<h2>Can we spot the schedules?<\/h2>\n<p>So much for Sundays. Can we use the finer-grained 1 minute data to detect people&#8217;s behaviour? The plots below show the period 14:00 to 22:00 on Christmas Day with annotations.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-799\" src=\"https:\/\/dataknut.files.wordpress.com\/2017\/01\/xmas_day_all.png\" alt=\"xmas_day_all\" width=\"700\" height=\"432\"><\/p>\n<p>There is a visible dip in demand around 15:00 coinciding with the Queen&#8217;s Speech and this appears to be preceded by a slight plateau in the otherwise continuous decline in demand. Perhaps people were making drinks or otherwise &#8216;getting ready&#8217; before Her Majesty spoke?<\/p>\n<p>There is an unexplained visible dip at 16:00 followed by a possible spike at the end of the BBC&#8217;s Christmas Bake-off and an even smaller spike at the end of the BBC&#8217;s Strictly Come Dancing.<\/p>\n<p>Separating out households with and without children (below) shows that the &#8216;plateau&#8217; before 15:00 was mostly due to households with children as is the 16:00 dip and the post-Bake-Off spike. The post-&#8216;Goodbye Len&#8217; spike at 20:00 was, however much more likely to be households without children.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-802\" src=\"https:\/\/dataknut.files.wordpress.com\/2017\/01\/xmas_day_kids1.png\" alt=\"xmas_day_kids\" width=\"1344\" height=\"1536\"><\/p>\n<p>Finally, if we separate out household by the age of the Household Response Person (HRP &#8211; who completed the survey), we see that it is the &#8216;younger&#8217; households who appear to reach for the appliances at the end of <em>Dr Who <\/em>and sometime after<em> Strictly<\/em>;&nbsp; &#8216;middle-aged&#8217; households who seemed to spike at the end of <em>Strictly<\/em> and &#8216;older&#8217; households (HRP aged 55+) who pay most attention to Her Majesty&#8230;<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-801\" src=\"https:\/\/dataknut.files.wordpress.com\/2017\/01\/xmas_day_hrpage.png\" alt=\"xmas_day_HRPage\" width=\"1344\" height=\"1536\"><\/p>\n<h2>About<\/h2>\n<p>The work was funded by the Low Carbon Network Fund (LCNF) through the <a href=\"http:\/\/www.energy.soton.ac.uk\/save-solent-achieving-value-from-efficiency\/\">Solent Achieving Value from Efficiency<\/a> project. The analysis was generated using <a href=\"https:\/\/cran.r-project.org\/package=knitr\">knitr<\/a> in <a href=\"http:\/\/www.rstudio.com\">RStudio<\/a> with R version 3.4.4 (2018-03-15) running on x86_64-redhat-linux-gnu. Analysis completed in 1056.318 seconds (17.61 minutes).<\/p>\n<p>R packages used for base SAVE data processing:<\/p>\n<ul>\n<li>base R &#8211; for the basics <span class=\"citation\">(R Core Team 2016)<\/span><\/li>\n<li>data.table &#8211; for fast (big) data handling <span class=\"citation\">(Dowle et al. 2015)<\/span><\/li>\n<li>Hmisc &#8211; for capitalize <span class=\"citation\">(Harrell Jr, Charles Dupont, and others. 2016)<\/span><\/li>\n<li>lubridate &#8211; for fast date\/time conversions <span class=\"citation\">(Grolemund and Wickham 2011)<\/span><\/li>\n<li>readxl &#8211; reading .xls(x) <span class=\"citation\">(Wickham and Bryan 2017)<\/span><\/li>\n<li>readr &#8211; fast .csv reading and parseing <span class=\"citation\">(Wickham, Hester, and Francois 2016)<\/span><\/li>\n<li>dplyr &#8211; data munching <span class=\"citation\">(Wickham and Francois 2016)<\/span><\/li>\n<li>dtplyr &#8211; data.table data munching <span class=\"citation\">(Wickham 2016)<\/span><\/li>\n<\/ul>\n<p>Additional R packages used:<\/p>\n<ul>\n<li>ggplot2 &#8211; slick graphics <span class=\"citation\">(Wickham 2009)<\/span><\/li>\n<li>knitr &#8211; to generate reports <span class=\"citation\">(Xie 2016)<\/span><\/li>\n<\/ul>\n<h2>Data Access<\/h2>\n<p>Staff and students at the University of Southampton can apply to use <a href=\"http:\/\/www.energy.soton.ac.uk\/save-data-sources\/\">anonymised versions of this data<\/a> for research purposes.<\/p>\n<div id=\"references\" class=\"section level1 unnumbered\">\n<h1>References<\/h1>\n<div id=\"refs\" class=\"references\">\n<div id=\"ref-data.table\">\n<div id=\"refs\" class=\"references\">\n<div id=\"ref-data.table\">\n<p>Dowle, M, A Srinivasan, T Short, S Lianoglou with contributions from R Saporta, and E Antonyan. 2015. <em>Data.table: Extension of Data.frame<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=data.table\">https:\/\/CRAN.R-project.org\/package=data.table<\/a>.<\/p>\n<\/div>\n<div id=\"ref-lubridate\">\n<p>Grolemund, Garrett, and Hadley Wickham. 2011. \u201cDates and Times Made Easy with lubridate.\u201d <em>Journal of Statistical Software<\/em> 40 (3): 1\u201325. <a class=\"uri\" href=\"http:\/\/www.jstatsoft.org\/v40\/i03\/\">http:\/\/www.jstatsoft.org\/v40\/i03\/<\/a>.<\/p>\n<\/div>\n<div id=\"ref-Hmisc\">\n<p>Harrell Jr, Frank E, with contributions from Charles Dupont, and many others. 2016. <em>Hmisc: Harrell Miscellaneous<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=Hmisc\">https:\/\/CRAN.R-project.org\/package=Hmisc<\/a>.<\/p>\n<\/div>\n<div id=\"ref-baseR\">\n<p>R Core Team. 2016. <em>R: A Language and Environment for Statistical Computing<\/em>. Vienna, Austria: R Foundation for Statistical Computing. <a class=\"uri\" href=\"https:\/\/www.R-project.org\/\">https:\/\/www.R-project.org\/<\/a>.<\/p>\n<\/div>\n<div id=\"ref-ggplot2\">\n<p>Wickham, Hadley. 2009. <em>Ggplot2: Elegant Graphics for Data Analysis<\/em>. Springer-Verlag New York. <a class=\"uri\" href=\"http:\/\/ggplot2.org\">http:\/\/ggplot2.org<\/a>.<\/p>\n<\/div>\n<div id=\"ref-dtplyr\">\n<p>\u2014\u2014\u2014. 2016. <em>Dtplyr: Data Table Back-End for \u2019Dplyr\u2019<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=dtplyr\">https:\/\/CRAN.R-project.org\/package=dtplyr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-readxl\">\n<p>Wickham, Hadley, and Jennifer Bryan. 2017. <em>Readxl: Read Excel Files<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=readxl\">https:\/\/CRAN.R-project.org\/package=readxl<\/a>.<\/p>\n<\/div>\n<div id=\"ref-dplyr\">\n<p>Wickham, Hadley, and Romain Francois. 2016. <em>Dplyr: A Grammar of Data Manipulation<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=dplyr\">https:\/\/CRAN.R-project.org\/package=dplyr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-readr\">\n<p>Wickham, Hadley, Jim Hester, and Romain Francois. 2016. <em>Readr: Read Tabular Data<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=readr\">https:\/\/CRAN.R-project.org\/package=readr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-knitr\">\n<p>Xie, Yihui. 2016. <em>Knitr: A General-Purpose Package for Dynamic Report Generation in R<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=knitr\">https:\/\/CRAN.R-project.org\/package=knitr<\/a>.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Author: Ben Anderson (b.anderson@soton.ac.uk, @dataknut) There is often talk in the media about the &#8216;spikes&#8217; in energy demand caused by breaks in television schedules &#8211; when everyone is supposed to jump up and put the kettle on (or whatever). Although these make for good media stories, the largest overall surges are probably to do with [&hellip;]<\/p>\n","protected":false},"author":93263,"featured_media":7247,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[125901,125902],"tags":[164906,16132,786097,11800,552652,552645,417932],"class_list":["post-7243","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-and-modelling","category-energy-behaviour","tag-christmas","tag-demand","tag-electricity","tag-power","tag-save","tag-smart-meter","tag-social-practices"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7243","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/users\/93263"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/comments?post=7243"}],"version-history":[{"count":2,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7243\/revisions"}],"predecessor-version":[{"id":7256,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7243\/revisions\/7256"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/media\/7247"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/media?parent=7243"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/categories?post=7243"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/tags?post=7243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}