A Framework for the Creation of Leap Motion Gestural Interfaces for Handwriting Education to Children with Development Coordination Disorder

Leonardo Ramon Nunes de Sousa, Ismar Frango Silveira

Abstract


Gestural interfaced-based computational tools can be more suitable than other kinds of interfaces during calligraphy education to children with Developmental Coordination Disorder. The touchless tools reduce difficulties with handwriting of these pupils because they do not require physical contact and they dispense efforts of fine motor skills needed to perform calligraphy. They also serve as a motivational tool and they are more intuitive than touchscreen and graphical user interfaces. This paper deals with concepts of Development Coordination Disorder and human-computer interaction principles and it proposes a framework with a set of specific guidelines for software for the development of gestural interfaces for calligraphy education to children with DCD. Containing 25 guidelines in 3 stages – Prototyping, Development and Evaluation, this model takes into account the characteristics of DCD and recognizes fine motor skills technologies, relating all proposed guidelines to each other and supports the creation of appropriate gestural interfaces to assist these children at this school stage.


Keywords


Gestural Interfaces, Framework, Guidelines, Developmental Coordination Disorder, Handwriting.

Full Text:

PDF

References


Adhikarla, V. K., Sodnik, J., Szolgay, P., & Jakus, G. (2015). Exploring direct 3d interaction for full horizontal parallax light field displays using leap motion controller. Sensors, 15(4), 8642-8663.

Bachmann, D., Weichert, F., & Rinkenauer, G. (2014). Evaluation of the leap motion controller as a new contact-free pointing device. Sensors, 15(1), 214-233.

Bassily, D., Georgoulas, C., Guettler, J., Linner, T., & Bock, T. (2014). Intuitive and adaptive robotic arm manipulation using the leap motion controller. In ISR/Robotik 2014; 41st International Symposium on Robotics; Proceedings of (pp. 1-7). VDE.

Becker, D., Mauer, J., Emer, S., Behar, P. A., & Assumpção, S. M. (2014). O uso de objetos de aprendizagem com alunos surdos no ensino superior. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE) (Vol. 25, No. 1, p. 832).

Bo, J., & Lee, C. M. (2013). Motor skill learning in children with developmental coordination disorder. Research in developmental disabilities, 34(6), 2047-2055.

Cantin, N., Ryan, J., & Polatajko, H. J. (2014). Impact of task difficulty and motor ability on visual-motor task performance of children with and without developmental coordination disorder. Human movement science, 34, 217-232.

Cardoso, A. A., & Magalhães, L. D. C. (2009). Bilateral coordination and motor sequencing in Brazilian children: preliminary construct validity and reliability analysis. Occupational therapy international, 16(2), 107-121.

Caro, K. (2014). Exergames for children with motor skills problems. ACM SIGACCESS Accessibility and Computing, (108), 20-26.

Caro, K., Martínez-García, A. I., Tentori, M., & Zavala-Ibarra, I. (2014). Designing exergames combining the use of fine and gross motor exercises to support self-care activities. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility (pp. 247-248). ACM.

Celletti, C., Mari, G., Ghibellini, G., Celli, M., Castori, M., & Camerota, F. (2015). Phenotypic variability in developmental coordination disorder: Clustering of generalized joint hypermobility with attention deficit/hyperactivity disorder, atypical swallowing and narrative difficulties. In American Journal of Medical Genetics Part C: Seminars in Medical Genetics (Vol. 169, No. 1, pp. 117-122).

Chang, S. H., & Yu, N. Y. (2010). Characterization of motor control in handwriting difficulties in children with or without developmental coordination disorder. Developmental Medicine & Child Neurology, 52(3), 244-250.

Chen, H. F., & Cohn, E. S. (2003). Social participation for children with developmental coordination disorder: conceptual, evaluation and intervention considerations. Physical & Occupational Therapy in Pediatrics, 23(4), 61-78.

Chen, F. C., Tsai, C. L., Biltz, G. R., Stoffregen, T. A., & Wade, M. G. (2015). Variations in cognitive demand affect heart rate in typically developing children and children at risk for developmental coordination disorder. Research in developmental disabilities, 38, 362-371.

Crawford, S. G., Wilson, B. N., & Dewey, D. (2001). Identifying developmental coordination disorder: consistency between tests. Physical & occupational therapy in pediatrics, 20(2-3), 29-50.

Curtis, J., Ruijs, L., de Vries, M., Winters, R., & Martens, J. B. (2009). Rehabilitation of handwriting skills in stroke patients using interactive games: a pilot study. In CHI'09 Extended Abstracts on Human Factors in Computing Systems (pp. 3931-3936). ACM.

Czyżewski, A., Dalka, P., Kunka, B., & Odya, P. (2014). Multimodal human-computer interfaces based on advanced video and audio analysis. In Human-Computer Systems Interaction: Backgrounds and Applications 3 (pp. 87-102). Springer International Publishing.

Dewey, D., Kaplan, B. J., Crawford, S. G., & Wilson, B. N. (2002). Developmental coordination disorder: associated problems in attention, learning, and psychosocial adjustment. Human movement science, 21(5), 905-918.

Dey, A. K., Abowd, G. D., & Salber, D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-computer interaction, 16(2), 97-166.

Ferguson, G. D., Jelsma, D., Jelsma, J., & Smits-Engelsman, B. C. M. (2013). The efficacy of two task-orientated interventions for children with Developmental Coordination Disorder: Neuromotor Task Training and Nintendo Wii Fit training. Research in developmental disabilities, 34(9), 2449-2461.

Ferguson, G. D., Jelsma, J., Versfeld, P., & Smits-Engelsman, B. C. M. (2014). Using the ICF framework to explore the multiple interacting factors associated with developmental coordination disorder. Current Developmental Disorders Reports, 1(2), 86-101.

Flapper, B. C., & Schoemaker, M. M. (2013). Developmental coordination disorder in children with specific language impairment: Co-morbidity and impact on quality of life. Research in developmental disabilities, 34(2), 756-763.

Fong, S. S., Ng, S. S., & Yiu, B. P. (2013). Slowed muscle force production and sensory organization deficits contribute to altered postural control strategies in children with developmental coordination disorder. Research in developmental disabilities, 34(9), 3040-3048.

Forsyth, K., Maciver, D., Howden, S., Owen, C., & Shepherd, C. (2008). Developmental Coordination Disorder: A synthesis of evidence to underpin an allied health professions' framework. International Journal of Disability, Development and Education, 55(2), 153-172.

Gaines, R., & Missiuna, C. (2007). Early identification: are speech/languageâ€impaired toddlers at increased risk for Developmental Coordination Disorder?. Child: care, health and development, 33(3), 325-332.

Garber, L. (2013). Gestural technology: Moving interfaces in a new direction [technology news]. Computer, 46(10), 22-25.

Geuze, R. H. (2003). Static balance and developmental coordination disorder. Human Movement Science, 22(4), 527-548.

Gonsalves, L., Campbell, A., Jensen, L., & Straker, L. (2015). Children with developmental coordination disorder play active virtual reality games differently than children with typical development. Physical therapy, 95(3), 360.

Hall, R. R. (2001). Prototyping for usability of new technology. International Journal of Human-Computer Studies, 55(4), 485-501.

Hsu, H. M., Lin, Y. C., Lin, W. J., Lin, C. J., Chao, Y. L., & Kuo, L. C. (2013). Quantification of handwriting performance: Development of a force acquisition pen for measuring hand-grip and pen tip forces. Measurement, 46(1), 506-513.

Huau, A., Velay, J. L., & Jover, M. (2015). Graphomotor skills in children with developmental coordination disorder (DCD): Handwriting and learning a new letter. Human movement science, 42, 318-332.

Jacoby, S., Josman, N., Jacoby, D., Koike, M., Itoh, Y., Kawai, N., ... & Weiss, P. L. (2006). Tangible user interfaces: Tools to examine, assess, and treat dynamic constructional processes in children with developmental coordination disorders. International Journal on Disability and Human Development, 5(3), 257.

Jarus, T., Ghanouni, P., Abel, R. L., Fomenoff, S. L., Lundberg, J., Davidson, S., ... & Zwicker, J. G. (2015). Effect of internal versus external focus of attention on implicit motor learning in children with developmental coordination disorder. Research in developmental disabilities, 37, 119-126.

Jeffries, R., Miller, J. R., Wharton, C., & Uyeda, K. (1991). User interface evaluation in the real world: a comparison of four techniques. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 119-124). ACM.

Jelsma, D., Geuze, R. H., Mombarg, R., & Smits-Engelsman, B. C. (2014). The impact of Wii Fit intervention on dynamic balance control in children with probable Developmental Coordination Disorder and balance problems. Human movement science, 33, 404-418.

Johnson, R. E.; Deutsch, P. (1993). How to design frameworks. Urbana, 51, 61801.

Jolly, C., & Gentaz, E. (2013). Analysis of cursive letters, syllables, and words handwriting in a French second-grade child with Developmental Coordination Disorder and comparison with typically developing children. Frontiers in psychology, 4.

Kaiser, M. L., Albaret, J. M., & Doudin, P. A. (2009). Relationship between visual-motor integration, eye-hand coordination, and quality of handwriting. Journal of Occupational Therapy, Schools, & Early Intervention, 2(2), 87-95.

Katartzi, E. S., & Vlachopoulos, S. P. (2011). Motivating children with developmental coordination disorder in school physical education: the self-determination theory approach. Research in developmental disabilities, 32(6), 2674-2682.

Kirby, A. (2011). Dyspraxia: Developmental Co-ordination Disorder. Souvenir Press.

Kirby, A., Edwards, L., & Sugden, D. (2011). Emerging adulthood in developmental co-ordination disorder: parent and young adult perspectives. Research in developmental disabilities, 32(4), 1351-1360.

Kirby, A., Sugden, D., & Purcell, C. (2014). Diagnosing developmental coordination disorders. Archives of disease in childhood, 99(3), 292-296.

Landin, N., Niklasson, A., Bosson, G., & Regnell, B. (1995). Development of object-oriented frameworks. Department of Communication System. Lund Institute of Technology, Lund University. Lund, Sweden.

Leapmotion (2017). Leapmotion App Store. Accessed in March, 04th, 2017: https://apps.leapmotion.com/.

Liu, Z., Zhang, Y., Rau, P. L. P., Choe, P., & Gulrez, T. (2015). Leap-motion based online interactive system for hand rehabilitation. In International Conference on Cross-Cultural Design (pp. 338-347). Springer International Publishing.

Magalhães, L. C., Cardoso, A. A., & Missiuna, C. (2011). Activities and participation in children with developmental coordination disorder: A systematic review. Research in developmental disabilities, 32(4), 1309-1316.

Mandich, A. D., Polatajko, H. J., & Rodger, S. (2003). Rites of passage: Understanding participation of children with developmental coordination disorder. Human movement science, 22(4), 583-595.

Martin, N. C., Piek, J. P., & Hay, D. (2006). DCD and ADHD: a genetic study of their shared aetiology. Human movement science, 25(1), 110-124.

Missiuna, C., Moll, S., King, S., King, G., & Law, M. (2007). A trajectory of troubles: parents' impressions of the impact of developmental coordination disorder. Physical & occupational therapy in pediatrics, 27(1), 81-101.

Missiuna, C., Rivard, L., & Pollock, N. (2011). Children with Developmental Coordination Disorder: At home, at school, and in the community. Mc Master University, Hamilton.

Miyahara, M., & Möbs, I. (1995). Developmental dyspraxia and developmental coordination disorder. Neuropsychology review, 5(4), 245-268.

Nho, Y. H., Seo, J. W., Seol, W. J., & Kwon, D. S. (2014). Emotional interaction with a mobile robot using hand gestures. In Ubiquitous Robots and Ambient Intelligence (URAI), 2014 11th International Conference on (pp. 506-509). IEEE.

Nielsen, J. (1994, April). Usability inspection methods. In Conference companion on Human factors in computing systems (pp. 413-414). ACM.

Nunes, L. R. & Silveira, I. F. (2015). Desafios das interfaces gestuais na aprendizagem de pessoas com dispraxia. Anais XXXV Congresso da Sociedade Brasileira de Computação(CSBC), Recife, Pernambuco, SBC.

Nunes, L. R., & Silveira, I. F. (2015). Ensino de Caligrafia para Dispráxicos utilizando Tecnologias Gestuais. Conferencias LACLO, 6(1), 326.

Nunes, L. R., & Silveira, I. F. (2015). A importância do desenvolvimento das interfaces gestuais para a aprendizagem de crianças com dispraxia. In: XIV Brazilian Symposium on Human Factors in Computer Systems (IHC), Salvador, Bahia, IHC.

Othman, M. F., & Keay-Bright, W. (2010). Using rotoscopy technique to assist the teaching of handwriting for children with dyspraxia. In Advances in Computer-Human Interactions, 2010. ACHI'10. Third International Conference on (pp. 175-178). IEEE.

Othman, M. F., & Keay-Bright, W. (2011). Rotoscopy-handwriting prototype: Using computer animation technique to assist the teaching of handwriting for children with dyspraxia. In Information Technology: New Generations (ITNG), 2011 Eighth International Conference on (pp. 464-469). IEEE.

Pauchot, J., Di Tommaso, L., Lounis, A., Benassarou, M., Mathieu, P., Bernot, D., & Aubry, S. (2015). Leap Motion Gesture Control With Carestream Software in the Operating Room to Control Imaging: Installation Guide and Discussion. Surgical innovation, 22(6), 615-620.

Placitelli, A. P., & Gallo, L. (2012). Toward a framework for rapid prototyping of touchless user interfaces. In Complex, Intelligent and Software Intensive Systems (CISIS), 2012 Sixth International Conference on (pp. 539-543). IEEE.

Polatajko, H. J., & Cantin, N. (2005). Developmental coordination disorder (dyspraxia): an overview of the state of the art. In Seminars in pediatric neurology (Vol. 12, No. 4, pp. 250-258). WB Saunders.

Portwood, M. (2013). Understanding developmental dyspraxia: A textbook for students and professionals. David Fulton Publishers.

Potter, L. E., Araullo, J., & Carter, L. (2013). The leap motion controller: a view on sign language. In Proceedings of the 25th Australian computer-human interaction conference: augmentation, application, innovation, collaboration (pp. 175-178). ACM.

Poulsen, A. A., & Ziviani, J. M. (2004). Can I play too? Physical activity engagement of children with developmental coordination disorders. Canadian Journal of Occupational Therapy, 71(2), 100-107.

Prates, R. O., & Barbosa, S. D. J. (2003). Avaliação de Interfaces de Usuário–Conceitos e Métodos. In Jornada de Atualização em Informática do Congresso da Sociedade Brasileira de Computação, Capítulo (Vol. 6).

Prates, R. O., de Souza, C. S., & Barbosa, S. D. (2000). Methods and tools: a method for evaluating the communicability of user interfaces. interactions, 7(1), 31-38.

Prunty, M. M., Barnett, A. L., Wilmut, K., & Plumb, M. S. (2013). Handwriting speed in children with Developmental Coordination Disorder: Are they really slower?. Research in developmental disabilities, 34(9), 2927-2936.

Prunty, M. M., Barnett, A. L., Wilmut, K., & Plumb, M. S. (2014). An examination of writing pauses in the handwriting of children with Developmental Coordination Disorder. Research in developmental disabilities, 35(11), 2894-2905.

Robert, M. P., Ingsterâ€Moati, I., Albuisson, E., Cabrol, D., Golse, B., & Vaivreâ€Douret, L. (2014). Vertical and horizontal smooth pursuit eye movements in children with developmental coordination disorder. Developmental Medicine & Child Neurology, 56(6), 595-600.

Saffer, D. (2008). Designing gestural interfaces: Touchscreens and interactive devices. " O'Reilly Media, Inc.".

Scordella, A., Di Sano, S., Aureli, T., Cerratti, P., Verratti, V., Fanò-Illic, G., & Pietrangelo, T. (2015). The role of general dynamic coordination in the handwriting skills of children. Frontiers in psychology, 6.

Seixas, M. C. B., Cardoso, J. C., & Dias, M. T. G. (2015). The Leap Motion movement for 2D pointing tasks: Characterisation and comparison to other devices. In Pervasive and Embedded Computing and Communication Systems (PECCS), 2015 International Conference on (pp. 15-24). IEEE.

Shen, J., Luo, Y., Wang, X., Wu, Z., & Zhou, M. (2014). Gpu-based realtime hand gesture interaction and rendering for volume datasets using leap motion. In Cyberworlds (CW), 2014 International Conference on (pp. 85-92). IEEE.

Silva, É. S., & Rodrigues, M. A. F. (2015). Gesture Interaction and Evaluation Using the Leap Motion for Medical Visualization. In Virtual and Augmented Reality (SVR), 2015 XVII Symposium on (pp. 160-169). IEEE.

Smits-Engelsman, B. C. M., Wilson, P. H., Westenberg, Y., & Duysens, J. (2003). Fine motor deficiencies in children with developmental coordination disorder and learning disabilities: An underlying open-loop control deficit. Human movement science, 22(4), 495-513.

Smits-Engelsman, B. C., Jelsma, L. D., Ferguson, G. D., & Geuze, R. H. (2015). Motor learning: an analysis of 100 trials of a ski slalom game in children with and without developmental coordination disorder. PloS one, 10(10), e0140470.

Smyth, M. M., & Mason, U. C. (1997). Planning and execution of action in children with and without developmental coordination disorder. Journal of Child Psychology and Psychiatry, 38(8), 1023-1037.

Snapp-Childs, W., Casserly, E., Mon-Williams, M., & Bingham, G. P. (2013). Active prospective control is required for effective sensorimotor learning. PloS one, 8(10), e77609.

Snapp-Childs, W., Mon-Williams, M., & Bingham, G. P. (2013). A sensorimotor approach to the training of manual actions in children with developmental coordination disorder. Journal of child neurology, 28(2), 204-212.

Still, B., & Morris, J. (2010). The blank-page technique: Reinvigorating paper prototyping in usability testing. IEEE Transactions on Professional Communication, 53(2), 144-157.

Sudirman, R., Tabatabaey-Mashadi, N., & Ariffin, I. (2011). Aspects of a standardized automated system for screening children's handwriting. In Informatics and Computational Intelligence (ICI), 2011 First International Conference on (pp. 49-54). IEEE.

Sugden, D. A., & Chambers, M. E. (1998). Intervention approaches and children with developmental coordination disorder. Pediatric Rehabilitation, 2(4), 139-147.

Sugden, D. A., & Chambers, M. E. (2003). Intervention in children with developmental coordination disorder: the role of parents and teachers. British journal of educational psychology, 73(4), 545-561.

Summers, J., Larkin, D., & Dewey, D. (2008). Activities of daily living in children with developmental coordination disorder: dressing, personal hygiene, and eating skills. Human movement science, 27(2), 215-229.

Sutton, J. (2013). Air painting with corel painter freestyle and the leap motion controller: A revolutionary new way to paint!. In ACM SIGGRAPH 2013 Studio Talks (p. 21). ACM.

Tarnanas, I., Schlee, W., Tsolaki, M., Müri, R., Mosimann, U., & Nef, T. (2013). Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study. JMIR Serious Games, 1(1), e1.

Thorvaldsen, S., Egeberg, G., Pettersen, G. O., & Vavik, L. (2011). Digital dysfunctions in primary school: A pilot study. Computers & Education, 56(1), 312-319.

Tresser, S. (2012). Case study: Using a novel virtual reality computer game for occupational therapy intervention. Presence: Teleoperators and Virtual Environments, 21(3), 359-371.

Vaivre-Douret, L., Lalanne, C., Ingster-Moati, I., Boddaert, N., Cabrol, D., Dufier, J. L., ... & Falissard, B. (2011). Subtypes of developmental coordination disorder: research on their nature and etiology. Developmental neuropsychology, 36(5), 614-643.

Visser, J. (2003). Developmental coordination disorder: a review of research on subtypes and comorbidities. Human movement science, 22(4), 479-493.

Weichert, F., Bachmann, D., Rudak, B., & Fisseler, D. (2013). Analysis of the accuracy and robustness of the leap motion controller. Sensors, 13(5), 6380-6393.

Wiethoff, A., Schneider, H., Rohs, M., Butz, A., & Greenberg, S. (2012). Sketch-a-TUI: low cost prototyping of tangible interactions using cardboard and conductive ink. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (pp. 309-312). ACM.

Wilson, P. H., & McKenzie, B. E. (1998). Information processing deficits associated with developmental coordination disorder: A metaâ€analysis of research findings. Journal of child psychology and psychiatry, 39(6), 829-840.

Wilson, P. H., Ruddock, S., Smitsâ€Engelsman, B. O. U. W. I. E. N., Polatajko, H., & Blank, R. (2013). Understanding performance deficits in developmental coordination disorder: a metaâ€analysis of recent research. Developmental Medicine & Child Neurology, 55(3), 217-228.

Zwicker, J. G., Missiuna, C., & Boyd, L. A. (2009). Neural correlates of developmental coordination disorder: a review of hypotheses. Journal of Child Neurology, 24(10), 1273-1281.

Zwicker, J. G., Missiuna, C., Harris, S. R., & Boyd, L. A. (2011). Brain activation associated with motor skill practice in children with developmental coordination disorder: an fMRI study. International Journal of Developmental Neuroscience, 29(2), 145-152.

Zwicker, J. G., Missiuna, C., Harris, S. R., & Boyd, L. A. (2012). Developmental coordination disorder: a review and update. European Journal of Paediatric Neurology, 16(6), 573-581.


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493