Detection Childhood of Apraxia of Speech From the Video Data Using PoseNet

Daribay Z., Kairanbay M., Daribayev Z.

2022 International Conference on Smart Information Systems and Technologies, SIST 2022, Nur-Sultan, Kazakhstan, 28 - 30 April 2022 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/sist54437.2022.9945794
  • City: Nur-Sultan
  • Country: Kazakhstan
  • Keywords: Childhood of Apraxia of Speech, detection of abnormal behaviour, PoseNet
  • Süleyman Demirel University Affiliated: No


© 2022 IEEE.Childhood of Apraxia of Speech (CAS) is a type of disorder that affects the speech of the children. Children who have a CAS found it difficult to control and coordinate the brain's neutrons in order to create sounds for the phrases. Therefore, while talking they behave themselves in abnormal way. This research work proposes the Computer Vision based solution in order to diagnose the patients agains CAS based on video content. We will be using the PoseNet Convolutional Neural Network (CNN) in order to track the pose of the child and fix abnormal behaviour while giving the interview. As a result we will be able to automatically identify whether the child has CAS or not.