Usability perceptions and beliefs about smart thermostats by chi-square test, signal detection theory, and fuzzy detection theory in regions of Mexico
Pedro PONCE1(), Therese PEFFER2, Arturo MOLINA1
1. Tecnologico de Monterrey, calle del puente 222 Mexico, Mexico City, Non-US/Non-Canadian 64849, Mexico 2. California Institute for Energy and Environment, University of California Berkeley, Berkeley, CA 94720, USA
It is well known that smart thermostats (STs) have become key devices in the implementation of smart homes; thus, they are considered as primary elements for the control of electrical energy consumption in households. Moreover, energy consumption is drastically affected when the end users select unsuitable STs or when they do not use the STs correctly. Furthermore, in future, Mexico will face serious electrical energy challenges that can be considerably resolved if the end users operate the STs in a correct manner. Hence, it is important to carry out an in-depth study and analysis on thermostats, by focusing on social aspects that influence the technological use and performance of the thermostats. This paper proposes the use of a signal detection theory (SDT), fuzzy detection theory (FDT), and chi-square (CS) test in order to understand the perceptions and beliefs of end users about the use of STs in Mexico. This paper extensively shows the perceptions and beliefs about the selected thermostats in Mexico. Besides, it presents an in-depth discussion on the cognitive perceptions and beliefs of end users. Moreover, it shows why the expectations of the end users about STs are not met. It also promotes the technological and social development of STs such that they are relatively more accepted in complex electrical grids such as smart grids.
. [J]. Frontiers in Energy, 2019, 13(3): 522-538.
Pedro PONCE, Therese PEFFER, Arturo MOLINA. Usability perceptions and beliefs about smart thermostats by chi-square test, signal detection theory, and fuzzy detection theory in regions of Mexico. Front. Energy, 2019, 13(3): 522-538.
T Peffer, M Pritoni, A Meier, C Aragon, D Perry. How people use thermostats in homes: a review. Building and Environment, 2011, 46(12): 2529–2541 https://doi.org/10.1016/j.buildenv.2011.06.002
3
J Rosas, C Sheinbaum, D Morillon. The structure of household energy consumption and related CO2 emissions by income group in Mexico. Energy for Sustainable Development, 2010, 14(2): 127–133 https://doi.org/10.1016/j.esd.2010.04.002
4
S Turber, J vom Brocke, O Gassmann, E Fleisch. Designing business models in the era of internet of things. In: Tremblay M C, VanderMeer D, Rothenberger M, Gupta A, Yoon V (eds), Advancing the Impact of Design Science: Moving from Theory to Practice. DESRIST 2014. Lecture Notes in Computer Science, vol 8463. Springer, Cham https://doi.org/10.1007/978-3-319-06701-8_2
5
M Pritoni, J Woolley, M P Modera. Do occupancy-responsive learning thermostats save energy? A field study in university residence halls. Energy and Buildings, 2016, 127: 469–478 https://doi.org/10.1016/j.enbuild.2016.05.024
6
A Meier, C Aragon, T Peffer, D Perry, M Pritoni. Usability of residential thermostats: preliminary investigations. Building and Environment, 2011, 46(10): 1891–1898 https://doi.org/10.1016/j.buildenv.2011.03.009
7
ENERGY.GOV. Energy saver: setting your thermostats for comfort and saving. 2016–09,
8
W Kleiminger, F Mattern, S Santini. Predicting household occupancy for smart heating control: a comparative performance analysis of state-of-the-art approaches. Energy and Building, 2014, 85: 493–505 https://doi.org/10.1016/j.enbuild.2014.09.046
9
A Keshtkar, S Arzanpour, F Keshtkar, P Ahmadi. Smart residential load reduction via fuzzy logic, wireless sensors, and smart grid incentives. Energy and Building, 2015, 104: 165–180 https://doi.org/10.1016/j.enbuild.2015.06.068
10
A Mahmood, N Javaid, S Razzaq. A review of wireless communications for smart grid. Renewable & Sustainable Energy Reviews, 2015, 41: 248–260 https://doi.org/10.1016/j.rser.2014.08.036
11
M Shipworth. Thermostat settings in English houses: no evidence of change between 1984 and 2007. Building and Environment, 2011, 46(3): 635–642 https://doi.org/10.1016/j.buildenv.2010.09.009
12
W Maarten. The research agenda on social acceptance of distributed generation in smart grids: renewable as common pool resources. Renewable & Sustainable Energy Reviews, 2012, 6(1): 822–835 https://doi.org/10.1016/j.rser.2011.09.006
13
G Assefa, B Frostell. Social sustainability and social acceptance in technology assessment: a case study of energy technologies. Technology in Society, 2007, 29(1): 6–78 https://doi.org/10.1016/j.techsoc.2006.10.007
14
R Uncles. What will lead to product acceptance and growing sales? In: Medical Equipment Industry-Potential for Growth Conference, 1998, 79–84
15
P Ponce, K Polasko, A Molina. Technology transfer motivation analysis based on fuzzy type-2 signal detection theory. AI & Society, 2016, 31(2): 245–257 https://doi.org/10.1007/s00146-015-0583-x
16
D McNicol. A Primer of Signal Detection Theory. Hove: Psychology Press, 2005
17
S Prasad, L M Bruce. Limitations of principal components analysis for hyperspectral target recognition. IEEE Geoscience and Remote Sensing Letters, 2008, 5(4): 625–629 https://doi.org/10.1109/LGRS.2008.2001282
18
M Pritoni, A K Meier, C Aragon, D Perry, T Peffer. Energy efficiency and the misuse of programmable thermostats: the effectiveness of crowdsourcing for understanding household behavior. Energy Research & Social Science, 2015, 8: 190–197 https://doi.org/10.1016/j.erss.2015.06.002
19
R. Cericola10 smart home apps that make you want the Apple Watch. 2015, available at electronichouse.com website
20
M Hamdi, G Lachiver. A fuzzy control system based on the human sensation of thermal comfort. In: IEEE World Congress on Computational Intelligence, IEEE International Conference on Fuzzy Systems Proceedings, Anchorage, AK, USA, 1998 https://doi.org/10.1109/FUZZY.1998.687534
21
J R Meyer, D T Uhrich. U.S. Patent No. 6101824, 2000
22
R G Boone, J Gordon, F Barnes, S Fraser-Beekman. Factors impacting innovation in a product development organization. In: IEEE International Conference on in Electro/Information Techno-logy (EIT), Indianapolis, IN, USA, 2012 https://doi.org/10.1109/EIT.2012.6220695
23
S Karjalainen. Gender differences in thermal comfort and use of thermostats in everyday thermal environments. Building and Environment, 2007, 42(4): 1594–1603 https://doi.org/10.1016/j.buildenv.2006.01.009
24
J W Moon, S H Han. Thermostat strategies impact on energy consumption in residential buildings. Energy and Building, 2011, 43(2): 338–346 https://doi.org/10.1016/j.enbuild.2010.09.024
25
J Nielsen, T K Landauer. A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, 1993, 206–213 https://doi.org/10.1145/169059.169166
26
J Nielsen. Why you only need to test with 5 users: alertbox. 2016–10,
L Faulkner. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers, 2003, 35(3): 379–383 https://doi.org/10.3758/BF03195514
pmid: 14587545
29
G Salvendy, J R Lewis. Handbook of Human Factors and Ergonomics. London: Wiley, 2006
30
N Mantel. Chi-square tests with one degree of freedom; extensions of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 1963, 58(303): 690–700 https://doi.org/10.1080/01621459.1963.10500879
31
M Conci, F Pianesi, M Zancanaro. Useful, social and enjoyable: Mobile phone adoption by older people. In: INTERACT’09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, 2009, 63–76 https://doi.org/10.1007/978-3-642-03655-2_7
32
National Institute of Statistic and Geography. Población (statistical information about population in Mexico). 2017–09,
33
National Institute of Statistic and Geography. “Estadísticas a propósito del… día mundial de internet (17 de mayo)”datos nacionales (statistical information about technology Mexico). 2017–09,
34
S W Campbell. Perceptions of mobile phones in college classrooms: ringing, cheating, and classroom policies. Communication Education, 2006, 55(3): 280–294 https://doi.org/10.1080/03634520600748573
N A Macmillan. Signal detection theory. In: Stevens’ Handbook of Experimental Psychology. London: Wiley, 2002
37
R Parasuraman, A J Masalonis, P A Hancock. Fuzzy signal detection theory: basic postulates and formulas for analyzing human and machine performance. Human Factors, 2000, 42(4): 636–659 https://doi.org/10.1518/001872000779697980
pmid: 11324856
38
H O Lancaster, E Seneta. Chi-square Distribution. London: John Wiley & Sons, Ltd, 1969
39
T Özdemir, E Eyduran. Comparison of chi-square and likelihood ratio chi-square tests: power of test. Journal of Applied Sciences Research, 2005, 1(2): 242–244 https://doi.org/10.1161/01.STR.0000014585.17714.67
40
H O Lancaster, E Seneta. Chi-square Distribution. London: John Wiley & Sons, Ltd, 2005
41
T M Franke, T Ho, C A Christie. The chi-square test often used and more often misinterpreted. American Journal of Evaluation, 2012, 33(3): 448–458 https://doi.org/10.1177/1098214011426594
42
J A Swets. Signal Detection and Recognition by Human Observers.New York: Wiley, 1964
43
W W Peterson, T G Birdsall, W C Fox. The theory of signal detectability. Proceedings of the IRE Professional Group on Information Theory, 1954, 4: 171–212 https://doi.org/10.1109/TIT.1954.1057460
44
J I Marcum. A statistical theory of target detection by pulsed radar. IRE Transactions on Information Theory, 1960, 6(2): 259–267 https://doi.org/10.1109/TIT.1960.1057560
45
C Paredes-Olay, M M Moreno-Fernández , J M Rosas, M M Ramos-Álvarez. ROC analysis in olive oil tasting: a signal detection theory approach to tasting tasks. Food Quality and Preference, 2010, 21(5): 562–568 https://doi.org/10.1016/j.foodqual.2010.03.003
46
D M Green, J A Swets. Signal Detection Theory and Psychophysics.New York: John Wiley & Sons Ltd., 1966
47
N A Macmillan, C C Douglas. Response bias: characteristics of detection theory, threshold theory, and “nonparametric” indexes. Psychological Bulletin, 1990, 107(3): 401–413 https://doi.org/10.1037/0033-2909.107.3.401
48
J G Snodgrass, J Corwin. Pragmatics of measuring recognition memory: applications to dementia and amnesia. Journal of Experimental Psychology: General, 1988, 117(1): 34–50 https://doi.org/10.1037/0096-3445.117.1.34
pmid: 2966230
49
A, Masalonis R. Parasuraman Fuzzy signal detection theory: analysis of human and machine performance in air traffic control, and analytic considerations. Ergonomics, 2003, 46(11): 1045–1074 https://doi.org/10.1080/0014013031000121986
50
R Parasuraman, A J Masalonis, P A Hancock. Fuzzy signal detection theory: basic postulates and formulas for analyzing human and machine performance. Human Factors, 2000, 42(4): 636–659 https://doi.org/10.1518/001872000779697980
pmid: 11324856
51
P Baptiste, S Trépanier, S Pireaux, S Quessy. Difficulties connected to the integration of resource management in operations management. Journal Européen des Systèmes Automatisés, 2004, 38: 773–795 (in French)
T Peffer, M Pritoni, A Meier, C Aragon, D Perry. How people use thermostats in homes: a review. Building and Environment, 2011, 46(12): 2529–2541 https://doi.org/10.1016/j.buildenv.2011.06.002
54
Fideicomiso para el Ahorro de Energía Eléctrica. Educación para el Ahorroy Uso Racional de la Energía Eléctrica Educaree. 2016–09,