A formative evaluation of human activity recognition technology for parent-child interactions

Authors

  • Adrián Macías Instituto Tecnológico de Sonora (ITSON)
  • Luis A. Castro Instituto Tecnológico de Sonora (ITSON)
  • Karina Caro Universidad Autónoma de Baja California (UABC)

DOI:

https://doi.org/10.47756/aihc.y9i1.152

Keywords:

Parent-Child Interaction, Activity Recognition, Wearable Sensors, Interaction-Monitoring, Augmented Garments, Wearables Design

Abstract

Studies in recognition of human activities have been developed in populations of all ages. It is possible to use various technologies to obtain data from environmental sensors or equipment, such as wheelchairs or wearable devices, for everyday and specialized use. With children, using augmented toys has become one of the preferred mechanisms to obtain information about the interaction between children and the toy. However, few efforts have been made to study mechanisms for receiving data from child and adult interactions. This work presents the design and evaluation of a computationally augmented glove and puzzle piece based on the specifications from the literature. After the evaluation, we proposed changes to the glove design to ensure the correct interaction data was obtained.

Downloads

Download data is not yet available.

References

Mauro Adenzato, Rita B. Ardito, and Elena Izard. 2006. Impact of Maternal Directiveness and Overprotectiveness on the Personality Development of a Sample of Individuals with Acquired Blindness. Soc. Behav. Personal. Int. J. 34, 1 (January 2006), 17–26. https://doi.org/10.2224/sbp.2006.34.1.17 DOI: https://doi.org/10.2224/sbp.2006.34.1.17

Ong Chin Ann and Lau Bee Theng. 2014. Human activity recognition: A review. In 2014 IEEE International Conference on Control System, Computing and Engineering (ICCSCE 2014), November 2014. 389–393. https://doi.org/10.1109/ICCSCE.2014.7072750 DOI: https://doi.org/10.1109/ICCSCE.2014.7072750

Miguel Ángel Bautista, Antonio Hernández-Vela, Sergio Escalera, Laura Igual, Oriol Pujol, Josep Moya, Verónica Violant, and María T. Anguera. 2016. A Gesture Recognition System for Detecting Behavioral Patterns of ADHD. IEEE Trans. Cybern. 46, 1 (January 2016), 136–147. https://doi.org/10.1109/TCYB.2015.2396635 DOI: https://doi.org/10.1109/TCYB.2015.2396635

Niko Bonomi and Michela Papandrea. 2022. Non-intrusive and Privacy Preserving Activity Recognition System for Infants Exploiting Smart Toys. In IoT Technologies for Health Care, 2022. Springer International Publishing, Cham, 3–18. https://doi.org/10.1007/978-3-030-99197-5_1 DOI: https://doi.org/10.1007/978-3-030-99197-5_1

Raquel Cañete, Sonia López, and M. Estela Peralta. 2021. KEYme: Multifunctional Smart Toy for Children with Autism Spectrum Disorder. Sustainability 13, 7 (January 2021), 4010. https://doi.org/10.3390/su13074010 DOI: https://doi.org/10.3390/su13074010

Cong Chen, Ajay Chander, and Kanji Uchino. 2019. Guided play: digital sensing and coaching for stereotypical play behavior in children with autism. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI ’19), March 17, 2019. Association for Computing Machinery, New York, NY, USA, 208–217. https://doi.org/10.1145/3301275.3302309 DOI: https://doi.org/10.1145/3301275.3302309

Iris Chin, Matthew S. Goodwin, Soroush Vosoughi, Deb Roy, and Letitia R. Naigles. 2018. Dense home-based recordings reveal typical and atypical development of tense/aspect in a child with delayed language development. J. Child Lang. 45, 1 (January 2018), 1–34. https://doi.org/10.1017/S0305000916000696 DOI: https://doi.org/10.1017/S0305000916000696

Francesca D. Faraci, Michela Papandrea, Alessandro Puiatti, Stefania Agustoni, Sara Giulivi, Vincenzo D’Apuzzo, Silvia Giordano, Flavio Righi, Olmo Barberis, Evelyne Thommen, and Emmanuelle Rossini. 2018. AutoPlay: a smart toys-kit for an objective analysis of children ludic behavior and development. In 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), June 2018. 1–6. https://doi.org/10.1109/MeMeA.2018.8438636 DOI: https://doi.org/10.1109/MeMeA.2018.8438636

Stephen V Faraone, Robert R Althoff, James J Hudziak, Michael Monuteaux, and Joseph Biederman. 2005. The CBCL predicts DSM bipolar disorder in children: a receiver operating characteristic curve analysis. Bipolar Disord. 7, 6 (2005), 518–524. https://doi.org/10.1111/j.1399-5618.2005.00271.x DOI: https://doi.org/10.1111/j.1399-5618.2005.00271.x

Carlos R. Flores-Carballo, Gabriel A. Molina-Arenas, Adrian Macias, Karina Caro, Jessica Beltran, and Luis A. Castro. 2023. Speaker Identification in Interactions between Mothers and Children with Down Syndrome via Audio Analysis: A Case Study in Mexico. Int. J. Human–Computer Interact. 39, 9 (May 2023), 1922–1937. https://doi.org/10.1080/10447318.2022.2090610 DOI: https://doi.org/10.1080/10447318.2022.2090610

Glenn Forbes, Stewart Massie, and Susan Craw. 2020. Fall prediction using behavioural modelling from sensor data in smart homes. Artif. Intell. Rev. 53, 2 (February 2020), 1071–1091. https://doi.org/10.1007/s10462-019-09687-7 DOI: https://doi.org/10.1007/s10462-019-09687-7

Biying Fu, Naser Damer, Florian Kirchbuchner, and Arjan Kuijper. 2020. Sensing Technology for Human Activity Recognition: A Comprehensive Survey. IEEE Access 8, (2020), 83791–83820. https://doi.org/10.1109/ACCESS.2020.2991891 DOI: https://doi.org/10.1109/ACCESS.2020.2991891

Yingxiang Gong and Zile Fan. 2023. Portable non-battery pressure monitoring gloves for basketball sport analysis. IEICE Electron. Express 20, 18 (2023), 20230343–20230343. https://doi.org/10.1587/elex.20.20230343 DOI: https://doi.org/10.1587/elex.20.20230343

Ruby C. Harris, Julia B. Robinson, Florence Chang, and Barbara M. Burns. 2007. Characterizing preschool children’s attention regulation in parent–child interactions: The roles of effortful control and motivation. J. Appl. Dev. Psychol. 28, 1 (January 2007), 25–39. https://doi.org/10.1016/j.appdev.2006.10.006 DOI: https://doi.org/10.1016/j.appdev.2006.10.006

Toshiki Hosoi, Kazuki Takashima, Tomoaki Adachi, Yuichi Itoh, and Yoshifumi Kitamura. 2014. A-blocks: recognizing and assessing child building processes during play with toy blocks. In SIGGRAPH Asia 2014 Emerging Technologies (SA ’14), November 24, 2014. Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/2669047.2669061 DOI: https://doi.org/10.1145/2669047.2669061

Charmi Jobanputra, Jatna Bavishi, and Nishant Doshi. 2019. Human Activity Recognition: A Survey. Procedia Comput. Sci. 155, (January 2019), 698–703. https://doi.org/10.1016/j.procs.2019.08.100 DOI: https://doi.org/10.1016/j.procs.2019.08.100

Nikolay L. Kazanskiy, Svetlana N. Khonina, and Muhammad A. Butt. 2024. A review on flexible wearables – Recent developments in non-invasive continuous health monitoring. Sens. Actuators Phys. 366, (February 2024), 114993. https://doi.org/10.1016/j.sna.2023.114993 DOI: https://doi.org/10.1016/j.sna.2023.114993

Danyal Khan, Naif Al Mudawi, Maha Abdelhaq, Abdulwahab Alazeb, Saud S. Alotaibi, Asaad Algarni, and Ahmad Jalal. 2024. A Wearable Inertial Sensor Approach for Locomotion and Localization Recognition on Physical Activity. Sensors 24, 3 (January 2024), 735. https://doi.org/10.3390/s24030735 DOI: https://doi.org/10.3390/s24030735

Karen Strohm Kitchner. 2009. Cognition, Metacognition, and Epistemic Cognition: A Three-Level Model of Cognitive Processing. Hum. Dev. 26, 4 (December 2009), 222–232. https://doi.org/10.1159/000272885 DOI: https://doi.org/10.1159/000272885

Joanne Lee and Eileen Wood. 2021. Examining Parent–Child Spatial Play Interaction Using Traditional Toys and Touch Screen Tablets. Parenting 21, 4 (October 2021), 304–331. https://doi.org/10.1080/15295192.2020.1811062 DOI: https://doi.org/10.1080/15295192.2020.1811062

Laurie Loop, Bénédicte Mouton, Elise Brassart, and Isabelle Roskam. 2017. The Observation of Child Behavior During Parent-Child Interaction: The Psychometric Properties of the Crowell Procedure. J. Child Fam. Stud. 26, 4 (April 2017), 1040–1050. https://doi.org/10.1007/s10826-016-0625-0 DOI: https://doi.org/10.1007/s10826-016-0625-0

Adrian Macias, Karina Caro, Luis A. Castro, and Jose-Fernando Parra. 2021. Exploring Player Experience of an Augmented Puzzle and Wearables for Studying Interactions between Parents and Children with Down Syndrome. In Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth ’20), February 02, 2021. Association for Computing Machinery, New York, NY, USA, 179–187. https://doi.org/10.1145/3421937.3422020 DOI: https://doi.org/10.1145/3421937.3422020

Adrian Macias, Jesus Ramos, Concepcion Valdez, Ignacio Garcia, Gabael Paez, Karina Caro, and Luis A. Castro. 2023. Mobile monitoring parents’ behaviors for supporting self-management in children with disabilities. J. Ambient Intell. Humaniz. Comput. 14, 1 (January 2023), 41–52. https://doi.org/10.1007/s12652-019-01293-3 DOI: https://doi.org/10.1007/s12652-019-01293-3

Julien Maitre, Clément Rendu, Kévin Bouchard, Bruno Bouchard, and Sébastien Gaboury. 2021. Object recognition in performed basic daily activities with a handcrafted data glove prototype. Pattern Recognit. Lett. 147, (July 2021), 181–188. https://doi.org/10.1016/j.patrec.2021.04.017 DOI: https://doi.org/10.1016/j.patrec.2021.04.017

Gabriela Marcu, Anind K. Dey, and Sara Kiesler. 2012. Parent-driven use of wearable cameras for autism support: a field study with families. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp ’12), September 05, 2012. Association for Computing Machinery, New York, NY, USA, 401–410. https://doi.org/10.1145/2370216.2370277 DOI: https://doi.org/10.1145/2370216.2370277

Smaragda Markaki and Costas Panagiotakis. 2023. Jigsaw puzzle solving techniques and applications: a survey. Vis. Comput. 39, 10 (October 2023), 4405–4421. https://doi.org/10.1007/s00371-022-02598-9 DOI: https://doi.org/10.1007/s00371-022-02598-9

Mario Muñoz-Organero, Lauren Powell, Ben Heller, Val Harpin, and Jack Parker. 2018. Automatic Extraction and Detection of Characteristic Movement Patterns in Children with ADHD Based on a Convolutional Neural Network (CNN) and Acceleration Images. Sensors 18, 11 (November 2018), 3924. https://doi.org/10.3390/s18113924 DOI: https://doi.org/10.3390/s18113924

Fnu Nazneen, Fatima A. Boujarwah, Shone Sadler, Amha Mogus, Gregory D. Abowd, and Rosa I. Arriaga. 2010. Understanding the challenges and opportunities for richer descriptions of stereotypical behaviors of children with asd: a concept exploration and validation. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility (ASSETS ’10), October 25, 2010. Association for Computing Machinery, New York, NY, USA, 67–74. https://doi.org/10.1145/1878803.1878817 DOI: https://doi.org/10.1145/1878803.1878817

Vignesh Ravichandran, Shehjar Sadhu, Daniel Convey, Sebastien Guerrier, Shubham Chomal, Anne-Marie Dupre, Umer Akbar, Dhaval Solanki, and Kunal Mankodiya. 2023. iTex Gloves: Design and In-Home Evaluation of an E-Textile Glove System for Tele-Assessment of Parkinson’s Disease. Sensors 23, 6 (2023), 2877. https://doi.org/10.3390/s23062877 DOI: https://doi.org/10.3390/s23062877

Lingmei Ren and Yanjun Peng. 2019. Research of Fall Detection and Fall Prevention Technologies: A Systematic Review. IEEE Access 7, (2019), 77702–77722. https://doi.org/10.1109/ACCESS.2019.2922708 DOI: https://doi.org/10.1109/ACCESS.2019.2922708

Diego Rivera, Antonio García, Bernardo Alarcos, Juan R. Velasco, José Eugenio Ortega, and Isaías Martínez-Yelmo. 2016. Smart Toys Designed for Detecting Developmental Delays. Sensors 16, 11 (November 2016), 1953. https://doi.org/10.3390/s16111953 DOI: https://doi.org/10.3390/s16111953

Lea Dujić Rodić and Andrina Granić. 2022. Tangible interfaces in early years’ education: a systematic review. Pers. Ubiquitous Comput. 26, 1 (February 2022), 39–77. https://doi.org/10.1007/s00779-021-01556-x DOI: https://doi.org/10.1007/s00779-021-01556-x

Hyeji Roh, Seulgi Shin, Jinseo Han, and Sangsoon Lim. 2021. A deep learning-based medication behavior monitoring system. Math. Biosci. Eng. MBE 18, 2 (January 2021), 1513–1528. https://doi.org/10.3934/mbe.2021078 DOI: https://doi.org/10.3934/mbe.2021078

Gulshan Saleem, Usama Ijaz Bajwa, and Rana Hammad Raza. 2023. Toward human activity recognition: a survey. Neural Comput. Appl. 35, 5 (February 2023), 4145–4182. https://doi.org/10.1007/s00521-022-07937-4 DOI: https://doi.org/10.1007/s00521-022-07937-4

Pann Thinzar Seint, Thi Thi Zin, and Mitsuhiro Yokota. 2018. Medication and Meal Intake Monitoring using Human-Object Interaction. In 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), October 2018. 399–400. https://doi.org/10.1109/GCCE.2018.8574854 DOI: https://doi.org/10.1109/GCCE.2018.8574854

Katta Spiel, Christopher Frauenberger, Os Keyes, and Geraldine Fitzpatrick. 2019. Agency of Autistic Children in Technology Research—A Critical Literature Review. ACM Trans. Comput.-Hum. Interact. 26, 6 (November 2019), 38:1-38:40. https://doi.org/10.1145/3344919 DOI: https://doi.org/10.1145/3344919

Victoria Tam, Mirko Gelsomini, and Franca Garzotto. 2017. Polipo: a Tangible Toy for Children with Neurodevelopmental Disorders. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’17), March 20, 2017. Association for Computing Machinery, New York, NY, USA, 11–20. https://doi.org/10.1145/3024969.3025006 DOI: https://doi.org/10.1145/3024969.3025006

Kristin Taraldsen, Sebastien F. M. Chastin, Ingrid I. Riphagen, Beatrix Vereijken, and Jorunn L. Helbostad. 2012. Physical activity monitoring by use of accelerometer-based body-worn sensors in older adults: A systematic literature review of current knowledge and applications. Maturitas 71, 1 (January 2012), 13–19. https://doi.org/10.1016/j.maturitas.2011.11.003 DOI: https://doi.org/10.1016/j.maturitas.2011.11.003

Miguel Ángel Valero, Maria Lindén, Juan Ramón Velasco, and Mats Björkman. 2014. Personalisation of Intelligent Homecare Services Adapted to Children with Motor Impairments. In Ubiquitous Computing and Ambient Intelligence. Personalisation and User Adapted Services, 2014. Springer International Publishing, Cham, 476–479. https://doi.org/10.1007/978-3-319-13102-3_76 DOI: https://doi.org/10.1007/978-3-319-13102-3_76

Emanuel Vonach, Marianne Ternek, Georg Gerstweiler, and Hannes Kaufmann. 2016. Design of a Health Monitoring Toy for Children. In Proceedings of the The 15th International Conference on Interaction Design and Children (IDC ’16), June 21, 2016. Association for Computing Machinery, New York, NY, USA, 58–67. https://doi.org/10.1145/2930674.2930694 DOI: https://doi.org/10.1145/2930674.2930694

Xiyue Wang, Kazuki Takashima, Tomoaki Adachi, and Yoshifumi Kitamura. 2021. Can Playing with Toy Blocks Reflect Behavior Problems in Children? In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, May 06, 2021. ACM, Yokohama Japan, 1–14. https://doi.org/10.1145/3411764.3445119 DOI: https://doi.org/10.1145/3411764.3445119

Tracy L. Westeyn, Gregory D. Abowd, Thad E. Starner, Jeremy M. Johnson, Peter W. Presti, and Kimberly A. Weaver. 2012. Monitoring children’s developmental progress using augmented toys and activity recognition. Pers. Ubiquitous Comput. 16, 2 (February 2012), 169–191. https://doi.org/10.1007/s00779-011-0386-0 DOI: https://doi.org/10.1007/s00779-011-0386-0

Lesley Xie, Alissa N. Antle, and Nima Motamedi. 2008. Are tangibles more fun? comparing children’s enjoyment and engagement using physical, graphical and tangible user interfaces. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI ’08), February 18, 2008. Association for Computing Machinery, New York, NY, USA, 191–198. https://doi.org/10.1145/1347390.1347433 DOI: https://doi.org/10.1145/1347390.1347433

Plusea. Instructables. Retrieved June 24, 2024 from https://www.instructables.com/member/Plusea/

Downloads

Published

2024-11-30

How to Cite

[1]
Macías, A. et al. 2024. A formative evaluation of human activity recognition technology for parent-child interactions. Avances en Interacción Humano-Computadora. 9, 1 (Nov. 2024), 91–98. DOI:https://doi.org/10.47756/aihc.y9i1.152.

Issue

Section

Research Papers

Most read articles by the same author(s)

1 2 > >> 

Similar Articles

1 2 3 4 5 6 7 8 9 > >> 

You may also start an advanced similarity search for this article.