{"id":7240,"date":"2018-05-31T01:14:25","date_gmt":"2018-05-31T01:14:25","guid":{"rendered":"http:\/\/blog.soton.ac.uk\/serg\/?p=7240"},"modified":"2018-05-31T21:42:09","modified_gmt":"2018-05-31T21:42:09","slug":"super-saturday-and-spikes-in-demand","status":"publish","type":"post","link":"https:\/\/blog.soton.ac.uk\/serg\/super-saturday-and-spikes-in-demand\/","title":{"rendered":"Super Saturday and spikes in demand"},"content":{"rendered":"<p><strong>Author<\/strong>: <a href=\"https:\/\/www.southampton.ac.uk\/engineering\/about\/staff\/ba1e12.page?#research\">Ben Anderson<\/a> (<a href=\"mailto:b.anderson@soton.ac.uk\">b.anderson@soton.ac.uk<\/a>, <a href=\"https:\/\/twitter.com\/dataknut\">@dataknut<\/a>)<\/p>\n<p>A while ago we posted a brief analysis of <a href=\"http:\/\/blog.soton.ac.uk\/serg\/a-most-unusual-sunday\/\">Christmas Day 2016<\/a> which showed that it was a most unusual Sunday. Although there was little evidence of positive&nbsp; &#8216;<a href=\"http:\/\/www.bbc.com\/news\/entertainment-arts-38414092\">spikes<\/a>&#8216; in household electricity demand due to <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2214629614000267\">synchronised<\/a> behaviour, HM The Queen&#8217;s TV broadcast appeared to cause a distinct negative spike and there were also differences between types of households. So what about Super Saturday, May 19th 2018 which contained not only the FA Cup but a Royal Wedding? Are similar patterns visible?<\/p>\n<p><!--more-->As before, this analysis uses a <a href=\"http:\/\/www.energy.soton.ac.uk\/save-data-sources\/\">stratified random sample of several thousand households<\/a> from the County of Hampshire, the Isle of Wight and the Cities of Southampton and Portsmouth who are taking part in a large-scale <a href=\"http:\/\/www.energy.soton.ac.uk\/tag\/save\/\">study<\/a> of energy demand. This sample is representative of these areas but possibly not of the wider UK population and we have been collecting 10 second power demand data from these households since late 2016.<\/p>\n<h2>Super Saturday: Just another Saturday?<\/h2>\n<p>In order to compare household demand patterns for Saturday May 19th 2018 with neighbouring Saturdays we extracted and aggregated the 10 second power demand data to give mean kW demand over each 1 minute and 5 minute period for the Saturdays before and after May 19th. This gives the plot shown below which also has 95% confidence intervals for the mean kW. These confidence intervals tell us several things, including how much variation there is between households at each time point.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-820\" src=\"https:\/\/dataknut.files.wordpress.com\/2018\/05\/saturdays1.png\" alt=\"saturdays.png\" width=\"931\" height=\"576\">As we can see, Super Saturday was not that different from most of the adjacent Saturdays. Although difficult to see due to the plot density, demand in the morning appeared to be spike at around 10:30 before falling sharply at around 12:00 when the wedding service began. It then picked up again in late afternoon ready for the football at which point it became largely indistinguishable from the other similar Saturdays.<\/p>\n<p>Strangely the &#8216;odd one out&#8217; seems to be the 12th May which looks an awful lot like a weekday&#8230; why?<\/p>\n<p><strong>Update 1\/6\/2018<\/strong>: As @tom_rushby <a href=\"https:\/\/twitter.com\/tom_rushby\/status\/1002193988345126912\">pointed out<\/a>, May 12th was <a href=\"https:\/\/www.accuweather.com\/en\/gb\/winchester\/so23-9\/may-weather\/323585\">much colder<\/a> than the Saturdays before\/after&#8230;<\/p>\n<h2>The Royal Wedding: As it happened&#8230;<\/h2>\n<p>Having looked across adjacent Saturdays, can we use the finer-grained 1 minute data to trace people&#8217;s behaviour through the morning of Super Saturday? The annotated plots below show the period 09:00 to 15:00 on Saturday 19th May 2018 using the 1 minute data.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-821\" src=\"https:\/\/dataknut.files.wordpress.com\/2018\/05\/wedding1min1.png\" alt=\"wedding1min.png\" width=\"1344\" height=\"1152\">Morning demand showed two peaks, one at just before 09:30 prior to the start of the &#8216;celebrity parade&#8217; and one at about 10:40. Both may have been caused by <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2214629614000267\">synchonised<\/a> &#8216;TV switch-on&#8217;? Demand then fell sharply as the service began at 12:00. Demand then generally increased as the service progressed through the Address (small dip at start?) towards its conclusion at 13:00 when there was another mini-peak. Demand then fell again as the carriage ride began before trending (with wobbles) downwards after the TV coverage ended.<\/p>\n<p>The following plot separates households by the age of the Household Response Person (HRP) who completed the household survey. As some households are yet to complete a survey, this plot is therefore based on a reduced sample size.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-822\" src=\"https:\/\/dataknut.files.wordpress.com\/2018\/05\/wedding1minbyage.png\" alt=\"wedding1minByAge.png\" width=\"1344\" height=\"1536\">Here we see that younger households (not the 55+ group) contributed to the spike just before 09:30 but all households contributed to the one at 10:40. The drop in demand at 12:00 was most noticeable for younger (age &lt; 55) households who tended to have higher demand in the first place.&nbsp; &#8216;Younger&#8217; households (18-34 group) showed more variation (paying less attention?) through the service, although this could be due to a smaller sub-sample size. &#8216;Older&#8217; households (HRP aged 55+) appeared to be the ones reaching for the appliances at the end of the service before watching the carriage circuit of Windsor.<\/p>\n<h2>The FA Cup: Who&#8217;s watching?<\/h2>\n<p>A similar analysis for the early evening of the same day also hints at demand responses. For example the plot below shows a mini-peak just before kick-off with a decline in demand shortly afterwards. There was a small blip around the time of the penalty goal although the error bars indicate substantial variation. Half-time could be marked by additional appliance use although again there is a lot of noise in the data but there is evidence of a mini-spike at ~19:00 when the game finished.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-823\" src=\"https:\/\/dataknut.files.wordpress.com\/2018\/05\/facup1min1.png\" alt=\"faCup1min.png\" width=\"1344\" height=\"960\"><\/p>\n<p>Separating by age as above provides slightly more clarity (see below). For example there is a much more noticeable drop in demand after kick-off for the 18-34 group and a more visible spike around the time of the goal. This group also increased demand substantially at half-time whilst the others did not. The 55+ group in particular appeared to engage in normal Saturday evening cooking (pre 18:00 peak) and eating (post 18:00 dip) <a href=\"https:\/\/link.springer.com\/chapter\/10.1007\/978-3-319-61991-0_10\">habits<\/a> whether they were watching or not.&nbsp; In contrast the 35-54 group appeared predominantly responsible for the full-time spike at 19:00.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-825\" src=\"https:\/\/dataknut.files.wordpress.com\/2018\/05\/facup1minbyage2.png\" alt=\"faCup1minByAge.png\" width=\"700\" height=\"432\"><\/p>\n<h2>About<\/h2>\n<p>This work was funded by:<\/p>\n<ul>\n<li>the UK Low Carbon Network Fund (LCNF) through the <a href=\"http:\/\/www.energy.soton.ac.uk\/save-solent-achieving-value-from-efficiency\/\">Solent Achieving Value from Efficiency<\/a> project;<\/li>\n<li>the EU via an EU H2020 funded <a href=\"http:\/\/www.energy.soton.ac.uk\/tag\/spatialec\">Marie Sk\u0142odowska-Curie Global Fellowship<\/a>.<\/li>\n<\/ul>\n<p>The analysis was generated using <a href=\"https:\/\/cran.r-project.org\/package=knitr\">knitr<\/a> in <a href=\"http:\/\/www.rstudio.com\">RStudio<\/a> with R version 3.4.4 (2018-03-15) running on x86_64-redhat-linux-gnu. Analysis completed in 1056.318 seconds (17.61 minutes).<\/p>\n<p>R packages used for base SAVE data processing:<\/p>\n<ul>\n<li>base R &#8211; for the basics <span class=\"citation\">(R Core Team 2016)<\/span><\/li>\n<li>data.table &#8211; for fast (big) data handling <span class=\"citation\">(Dowle et al. 2015)<\/span><\/li>\n<li>Hmisc &#8211; for capitalize <span class=\"citation\">(Harrell Jr, Charles Dupont, and others. 2016)<\/span><\/li>\n<li>lubridate &#8211; for fast date\/time conversions <span class=\"citation\">(Grolemund and Wickham 2011)<\/span><\/li>\n<li>readxl &#8211; reading .xls(x) <span class=\"citation\">(Wickham and Bryan 2017)<\/span><\/li>\n<li>readr &#8211; fast .csv reading and parseing <span class=\"citation\">(Wickham, Hester, and Francois 2016)<\/span><\/li>\n<li>dplyr &#8211; data munching <span class=\"citation\">(Wickham and Francois 2016)<\/span><\/li>\n<li>dtplyr &#8211; data.table data munching <span class=\"citation\">(Wickham 2016)<\/span><\/li>\n<\/ul>\n<p>Additional R packages used:<\/p>\n<ul>\n<li>ggplot2 &#8211; slick graphics <span class=\"citation\">(Wickham 2009)<\/span><\/li>\n<li>knitr &#8211; to generate reports <span class=\"citation\">(Xie 2016)<\/span><\/li>\n<\/ul>\n<div id=\"references\" class=\"section level1 unnumbered\">\n<h2>Data Access<\/h2>\n<p>Staff and students at the University of Southampton can apply to use <a href=\"http:\/\/www.energy.soton.ac.uk\/save-data-sources\/\">anonymised versions of this data<\/a> for research purposes.<\/p>\n<h1>References<\/h1>\n<div id=\"refs\" class=\"references\">\n<div id=\"ref-data.table\">\n<div id=\"refs\" class=\"references\">\n<div id=\"ref-data.table\">\n<p>Dowle, M, A Srinivasan, T Short, S Lianoglou with contributions from R Saporta, and E Antonyan. 2015. <em>Data.table: Extension of Data.frame<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=data.table\">https:\/\/CRAN.R-project.org\/package=data.table<\/a>.<\/p>\n<\/div>\n<div id=\"ref-lubridate\">\n<p>Grolemund, Garrett, and Hadley Wickham. 2011. \u201cDates and Times Made Easy with lubridate.\u201d <em>Journal of Statistical Software<\/em> 40 (3): 1\u201325. <a class=\"uri\" href=\"http:\/\/www.jstatsoft.org\/v40\/i03\/\">http:\/\/www.jstatsoft.org\/v40\/i03\/<\/a>.<\/p>\n<\/div>\n<div id=\"ref-Hmisc\">\n<p>Harrell Jr, Frank E, with contributions from Charles Dupont, and many others. 2016. <em>Hmisc: Harrell Miscellaneous<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=Hmisc\">https:\/\/CRAN.R-project.org\/package=Hmisc<\/a>.<\/p>\n<\/div>\n<div id=\"ref-baseR\">\n<p>R Core Team. 2016. <em>R: A Language and Environment for Statistical Computing<\/em>. Vienna, Austria: R Foundation for Statistical Computing. <a class=\"uri\" href=\"https:\/\/www.R-project.org\/\">https:\/\/www.R-project.org\/<\/a>.<\/p>\n<\/div>\n<div id=\"ref-ggplot2\">\n<p>Wickham, Hadley. 2009. <em>Ggplot2: Elegant Graphics for Data Analysis<\/em>. Springer-Verlag New York. <a class=\"uri\" href=\"http:\/\/ggplot2.org\">http:\/\/ggplot2.org<\/a>.<\/p>\n<\/div>\n<div id=\"ref-dtplyr\">\n<p>\u2014\u2014\u2014. 2016. <em>Dtplyr: Data Table Back-End for \u2019Dplyr\u2019<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=dtplyr\">https:\/\/CRAN.R-project.org\/package=dtplyr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-readxl\">\n<p>Wickham, Hadley, and Jennifer Bryan. 2017. <em>Readxl: Read Excel Files<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=readxl\">https:\/\/CRAN.R-project.org\/package=readxl<\/a>.<\/p>\n<\/div>\n<div id=\"ref-dplyr\">\n<p>Wickham, Hadley, and Romain Francois. 2016. <em>Dplyr: A Grammar of Data Manipulation<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=dplyr\">https:\/\/CRAN.R-project.org\/package=dplyr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-readr\">\n<p>Wickham, Hadley, Jim Hester, and Romain Francois. 2016. <em>Readr: Read Tabular Data<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=readr\">https:\/\/CRAN.R-project.org\/package=readr<\/a>.<\/p>\n<\/div>\n<div id=\"ref-knitr\">\n<p>Xie, Yihui. 2016. <em>Knitr: A General-Purpose Package for Dynamic Report Generation in R<\/em>. <a class=\"uri\" href=\"https:\/\/CRAN.R-project.org\/package=knitr\">https:\/\/CRAN.R-project.org\/package=knitr<\/a>.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Author: Ben Anderson (b.anderson@soton.ac.uk, @dataknut) A while ago we posted a brief analysis of Christmas Day 2016 which showed that it was a most unusual Sunday. Although there was little evidence of positive&nbsp; &#8216;spikes&#8216; in household electricity demand due to synchronised behaviour, HM The Queen&#8217;s TV broadcast appeared to cause a distinct negative spike and [&hellip;]<\/p>\n","protected":false},"author":93263,"featured_media":7241,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[125901,125902],"tags":[786097,1078768,552654,11800,1078767,552652,552645,417932],"class_list":["post-7240","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-and-modelling","category-energy-behaviour","tag-electricity","tag-fa-cup","tag-households","tag-power","tag-royal-wedding","tag-save","tag-smart-meter","tag-social-practices"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7240","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/users\/93263"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/comments?post=7240"}],"version-history":[{"count":7,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7240\/revisions"}],"predecessor-version":[{"id":7262,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/posts\/7240\/revisions\/7262"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/media\/7241"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/media?parent=7240"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/categories?post=7240"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/serg\/wp-json\/wp\/v2\/tags?post=7240"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}