A Review on Brain-Controlled Home Automation

Rajesh Rishi, Shakuntala Laskar

Abstract


A "smart home" employs ambient intelligence to keep tabs on things around the house so that the owner may get services tailored to their specific needs and control their home appliances from afar. Home automation for the elderly and handicapped focuses on enabling older persons and those with disabilities to live safely and comfortably at home. Additionally, the integration of this technology with a brain-computer interface (BCI) is perhaps of tremendous usefulness to those who are either old or disabled. These BCI-based brain-controlled home automation (BCHA) systems have emerged as a viable option for people with neuro disorders to remain in their homes rather than move to assisted living facilities. To summarize, BCI-based BCHA for the elderly and handicapped people is transforming people's lives every day. Most individuals prefer a simple approach to save time and effort. Automating the house is the simplest way for individuals to save time and effort. The brain-computer interface, often known as a BCI, is an innovative method of human-computer connection that does not rely on conventional output channels (muscle tissue and peripheral nerve). Over the course of the last three decades, it has attracted the attention of industry experts and developed into a thriving centre for research. Brain-controlled home automation (BCHA), as a typical BCI application, may provide physically challenged people with a new communication route with the outside world. However, the primary challenge that BCHA faces is to rapidly decipher multi-degree-of-freedom control instructions extracted from an electroencephalogram (EEG). The BCHA's research has made significant headway in a short amount of time during the last fifteen years. This study investigates the BCHA from several viewpoints, including the pattern of instructions for the control system, the type of signal acquisition, and the operational mechanism of the control system itself. This paper a concise description of the building blocks of smart homes and how they may be used to construct BCI-controlled home automation to assist disabled individuals. It is a compilation of information pertaining to communication protocols, multimedia devices, sensors, and systems that are often used in the process of putting smart homes into action. A comprehensive strategy for developing a functional and sustainable BCI-controlled home automation system is laid out in this paper as well, which could be useful to researchers in the future.

Keywords


Brain-computer interface (BCI); BCI-based brain-controlled home automation (BCHA); Home automation; neuro disorders; rehabilitative medicine

Full Text:

PDF

References


"Ageing and health", World Health Organization, 1 Oct. 2022. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/ageing-and-health. [Accessed: Oct. 14, 2022]

"World Report on Disability 2011", World Health Organization, 14 Dec. 2011. [Online]. Available: https://www.who.int/teams/noncommunicable-diseases/sensory-functions-disability-and-rehabilitation/world-report-on-disability [Accessed: Oct. 1, 2022]

L. C. Wijesekera and P. Nigel Leigh, "Amyotrophic lateral sclerosis," Orphanet Journal of Rare Diseases, vol. 4, no. 1, p. 3, Feb. 2009, doi: https://doi.org/10.1186/1750-1172-4-3

S. C. Kirshblum et al., "International Standards for Neurological Classification of Spinal Cord Injury: Cases with classification challenges," The Journal of Spinal Cord Medicine, vol. 37, no. 2, pp. 120–127, Mar. 2014, doi: 10.1179/2045772314Y.0000000196

P. Bach-y-Rita, "Brain plasticity as a basis for recovery of function in humans," Neuropsychologia, vol. 28, no. 6, pp. 547–554, Jan. 1990, doi: 10.1016/0028-3932(90)90033-K

J. R. Wolpaw and E. W. Wolpaw (Eds.), Brain-Computer Interfaces: Principles and Practice, Oxford University Press, 2012.

J. R. Wolpaw et al., "Brain-computer interface technology: a review of the first international meeting," IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 164–173, Jun. 2000, doi: 10.1109/TRE.2000.847807.

R. Zhang et al., "A BCI-Based Environmental Control System for Patients With Severe Spinal Cord Injuries," IEEE Transactions on Biomedical Engineering, vol. 64, no. 8, pp. 1959–1971, Aug. 2017, doi: 10.1109/TBME.2016.2628861.

R. Lutolf, "Smart Home concept and the integration of energy meters into a home based system," in Seventh International Conference on Metering Apparatus and Tariffs for Electricity Supply 1992, Nov. 1992, pp. 277–278. Available: https://ieeexplore.ieee.org/document/187310

V. Berlo, A. Bob, E. Jan, F. Klaus, H. Maik, W. Charles, Design Guidelines on Smart Homes, A COST 219bis Guidebook, European Commission, 1999.

B. Winkler, An implementation of an ultrasonic indoor tracking system supporting the OSGI architecture of the ICTA lab, Doctoral dissertation, University of Florida, 2002.

D. D. Briere and P. J. Hurley, Smart homes for dummies, 2nd ed., New York: Wiley Pub, 2003.

SMART HOME – A DEFINITION, Housing LIN intro factsheet, Housing Learning & Improvement Network. [Online]. Avilable: https://www.housinglin.org.uk/_assets/Resources/Housing/Housing_advice/Smart_Home_-_A_definition_September_2003.pdf [Accessed: Feb. 04, 2023]

L. Satpathy, "Smart Housing: Technology to Aid Aging in Place - New Opportunities and Challenges," M.Sc Thesis, 3967, College of Architecture, Art and Design, Mississippi State University, August 2006. [Online]. Available: https://scholarsjunction.msstate.edu/td/3967/

S. A. Khoshnevis and R. Sankar, "Applications of Higher Order Statistics in Electroencephalography Signal Processing: A Comprehensive Survey," IEEE Reviews in Biomedical Engineering, vol. 13, pp. 169–183, 2020, doi: 10.1109/RBME.2019.2951328.

D. P. Subha, P. K. Joseph, R. Acharya U, and C. M. Lim, "EEG Signal Analysis: A Survey," J Med Syst, vol. 34, no. 2, pp. 195–212, Apr. 2010, doi: 10.1007/s10916-008-9231-z

J. R. Wolpaw, "Brain-computer interfaces (BCIs) for communication and control," in Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, New York, NY, USA, Oct. 2007, pp. 1–2, doi: 10.1145/1296843.1296845

A. Delorme and S. Makeig, "EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis," Journal of Neuroscience Methods, vol. 134, no. 1, pp. 9–21, Mar. 2004, doi: 10.1016/j.jneumeth.2003.10.009

J. Kaur and A. Kaur, "A review on analysis of EEG signals," in 2015 International Conference on Advances in Computer Engineering and Applications, Mar. 2015, pp. 957–960, doi: 10.1109/ICACEA.2015.7164844.

S. K. Das, D. J. Cook, A. Battacharya, E. O. Heierman, and T.-Y. Lin, "The role of prediction algorithms in the MavHome smart home architecture," IEEE Wireless Communications, vol. 9, no. 6, pp. 77–84, Dec. 2002, doi: 10.1109/MWC.2002.1160085.

G. M. Youngblood, D. J. Cook, and L. B. Holder, "Managing Adaptive Versatile environments," Pervasive and Mobile Computing, vol. 1, no. 4, pp. 373–403, Dec. 2005, doi: 10.1016/j.pmcj.2005.08.004

K. Gopalratnam and D. J. Cook, "Online Sequential Prediction via Incremental Parsing: The Active LeZi Algorithm," IEEE Intelligent Systems, vol. 22, no. 1, pp. 52–58, Jan. 2007, doi: 10.1109/MIS.2007.15.

G. M. Youngblood and D. J. Cook, "Data Mining for Hierarchical Model Creation," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 37, no. 4, pp. 561–572, Jul. 2007, doi: 10.1109/TSMCC.2007.897341.

H. Noguchi, T. Mori, and T. Sato, "Construction of network system and the first step of summarization for human daily action data in the sensing room," in Proceedings. IEEE Workshop on Knowledge Media Networking, Jul. 2002, pp. 17–22, doi: 10.1109/KMN.2002.1115157.

T. Yamazaki, "Beyond the Smart Home," in 2006 International Conference on Hybrid Information Technology, Nov. 2006, vol. 2, pp. 350–355, doi: 10.1109/ICHIT.2006.253633.

C.-H. Lu and L.-C. Fu, "Robust Location-Aware Activity Recognition Using Wireless Sensor Network in an Attentive Home," IEEE Transactions on Automation Science and Engineering, vol. 6, no. 4, pp. 598–609, Oct. 2009, doi: 10.1109/TASE.2009.2021981.

T. Ma, Y.-D. Kim, Q. Ma, M. Tang, and W. Zhou, "Context-aware implementation based on CBR for smart home," in WiMob'2005, IEEE International Conference on Wireless And Mobile Computing, Networking And Communications, 2005., Aug. 2005, vol. 4, pp. 112-115 Vol. 4, doi: 10.1109/WIMOB.2005.1512957.

T. Perumal, A. R. Ramli, and C. Y. Leong, "Design and implementation of SOAP-based residential management for smart home systems," IEEE Transactions on Consumer Electronics, vol. 54, no. 2, pp. 453–459, May 2008, doi: 10.1109/TCE.2008.4560114.

C.-L. Wu, C.-F. Liao, and L.-C. Fu, "Service-Oriented Smart-Home Architecture Based on OSGi and Mobile-Agent Technology," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 37, no. 2, pp. 193–205, Mar. 2007, doi: 10.1109/TSMCC.2006.886997.

Knopflerfish - Open Source OSGi SDK and run-time container [Online]. Avilable: http://www.knopflerfish.org/ [Accessed: Feb. 06, 2023]

A. E. Nikolaidis, S. Papastefanos, G. A. Doumenis, G. I. Stassinopoulos, and M. P. K. Drakos, "Local and remote management integration for flexible service provisioning to the home," IEEE Communications Magazine, vol. 45, no. 10, pp. 130–138, Oct. 2007, doi: 10.1109/MCOM.2007.4342828..

J. Yongping, F. Zehao, and X. Du, "Design and Application of Wirless Sensor Network Web Server Based on S3C2410 and Zigbee Protocol," in 2009 International Conference on Networks Security, Wireless Communications and Trusted Computing, Apr. 2009, vol. 2, pp. 28–31, doi: 10.1109/NSWCTC.2009.404.

C.-Y. Chen, Y.-P. Tsoul, S.-C. Liao, and C.-T. Lin, "Implementing the design of smart home and achieving energy conservation," in 2009 7th IEEE International Conference on Industrial Informatics, Jun. 2009, pp. 273–276, doi: 10.1109/INDIN.2009.5195816.

B. S. Zainuddin, Z. Hussain, and I. S. Isa, "Alpha and beta EEG brainwave signal classification technique: A conceptual study," in 2014 IEEE 10th International Colloquium on Signal Processing and its Applications, Mar. 2014, pp. 233–237, doi: 10.1109/CSPA.2014.6805755.

Z. Koudelková and M. Strmiska, "Introduction to the identification of brain waves based on their frequency," MATEC Web Conf., vol. 210, p. 05012, 2018, doi: https://www.matec-conferences.org/10.1051/matecconf/201821005012

M. Roohi-Azizi, L. Azimi, S. Heysieattalab, and M. Aamidfar, "Changes of the brain's bioelectrical activity in cognition, consciousness, and some mental disorders," Medical Journal of The Islamic Republic of Iran (MJIRI), vol. 31, no. 1, pp. 307–312, Dec. 2017. Available: https://mjiri.iums.ac.ir/article-1-4337-en.html

N. Jatupaiboon, S. Pan-ngum, and P. Israsena, "Real-Time EEG-Based Happiness Detection System," The Scientific World Journal, vol. 2013, pp. 1–12, 2013, doi: 10.1155/2013/618649

K. S. Manic, A. Saadha, K. Pirapaharan, and Aravind CV. "Characterisation and separation of brainwave signals." Journal Of Engineering Science And Technology, EURECA (2014), pp. 32-44. Available: https://www.researchgate.net/publication/292544490_Characterisation_and_separation_of_brainwave_signals

C. I. Penaloza, Y. Mae, F. F. Cuellar, M. Kojima, and T. Arai, "Brain Machine Interface System Automation Considering User Preferences and Error Perception Feedback," IEEE Transactions on Automation Science and Engineering, vol. 11, no. 4, pp. 1275–1281, Oct. 2014, doi: 10.1109/TASE.2014.2339354.

V. K. K. Shivappa, B. Luu, M. Solis, and K. George, "Home automation system using brain computer interface paradigm based on auditory selection attention," in 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), May 2018, pp. 1–6, doi: 10.1109/I2MTC.2018.8409863.

R. Zhang et al., "A BCI-Based Environmental Control System for Patients With Severe Spinal Cord Injuries," IEEE Transactions on Biomedical Engineering, vol. 64, no. 8, pp. 1959–1971, Aug. 2017, doi: 10.1109/TBME.2016.2628861.

A. A. Ghodake and S. D. Shelke, "Brain controlled home automation system," in 2016 10th International Conference on Intelligent Systems and Control (ISCO), Jan. 2016, pp. 1–4, doi: 10.1109/ISCO.2016.7727050.

H. Cho, J. Goo, D. Suh, K. S. Park, and M. Hahn, "The Virtual Reality Brain-Computer Interface System for Ubiquitous Home Control," in AI 2006: Advances in Artificial Intelligence, Berlin, Heidelberg, 2006, pp. 992–996, doi: 10.1007/11941439_110.

U. Hoffmann, J.-M. Vesin, T. Ebrahimi, and K. Diserens, "An efficient P300-based brain–computer interface for disabled subjects," Journal of Neuroscience Methods, vol. 167, no. 1, pp. 115–125, Jan. 2008, doi: 10.1016/j.jneumeth.2007.03.005




Copyright (c) 2023

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Call for Paper for the upcoming issue


The journal welcomes publications of high-quality research papers, review papers, white papers, conference papers, etc. on theoretical developments and practical applications in the domain of Electrical and Electronics and its allied sciences.

Authors are solicited to contribute to the journal by submitting articles that illustrate original research works, short communications and review articles in the thrust areas of the journal as mentioned on the About page.

Submission and Template:

  • The downloadable Template and the Online submission link are available on the PAPER SUBMISSION page.
 
ADBU Journal of Electrical and Electronics Engineering (AJEEE) - ISSN: 2582-0257 is an International peer-reviewed Open-Access Online journal in the English language that publishes scientific articles which contribute new novel experimentation and theoretical work in all areas of Electrical and Electronics Engineering and its applications.

* The views, interpretations and opinions expressed in the articles are those of the author(s) and should not be considered to reflect the opinions of the Editorial Board of this journal- AJEEE.

Creative Commons License