PECS+: An Intelligent Hybrid Communication System Integrating Phase-Locked Learning Architecture, NFC-Based Interaction, Adaptive Learning, and Emotion Recognition

Abstract

This study introduces PECS+, a technology-enhanced communication system designed to digitize and improve the traditional Picture Exchange Communication System (PECS) used in special education. The proposed system aims to support individuals with Autism Spectrum Disorder (ASD) who experience difficulties in verbal and functional communication. PECS+ integrates traditional physical card interaction with digital technologies through Near Field Communication (NFC) enabled cards that trigger multimedia feedback via a mobile application. A Phase-Locked learning architecture is implemented to ensure that learners progress through the six PECS phases in the correct pedagogical order while preventing unauthorized phase skipping. The system automatically records communication attempts and interaction data, enabling objective monitoring of learner progress and reducing manual data collection for educators. To enhance personalization, an artificial intelligence–based Adaptive Learning Engine analyzes interaction patterns and dynamically adjusts task difficulty and communication card recommendations according to learner performance. In addition, an Emotion Recognition Module is incorporated to detect learners’ emotional states through facial expression analysis during interaction sessions. By combining behavioral interaction data with emotion analysis, the system can deliver emotion-aware feedback and adjust instructional prompts in real time. Furthermore, an educator dashboard visualizes learning analytics and supports data-driven decision making within individualized education programs. Overall, PECS+ presents a scalable and adaptive communication support framework that combines physical interaction, artificial intelligence, and emotion-aware computing to enhance communication training in modern special education environments.