학술논문

EEG Based Thought-to-Text Translation Via Deep Learning
Document Type
Conference
Source
2023 7th International Multi-Topic ICT Conference (IMTIC) Multi-Topic ICT Conference (IMTIC), 2023 7th International. :1-8 May, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Fields, Waves and Electromagnetics
Photonics and Electrooptics
Robotics and Control Systems
Signal Processing and Analysis
Deep learning
Keyboards
Brain modeling
Electroencephalography
Real-time systems
Servers
Task analysis
Thought-to-Text Converter
Convolutional Neural Networks
Recurrent Neural Networks
Electroencephalography Signals
BCI
Language
Abstract
Major contributors to impairment are neurological conditions such epilepsy, Alzheimer's disease, multiple sclerosis, Parkinson's disease, and others. These neurodegenerative conditions are life-altering, and those afflicted with them must fight a new battle every day. This manuscript presents the implementation of a Thought-to-Text Conversion BCI system. The system employs a joint CNN-LSTM deep neural network to learn high-level features from MI-EEG signals. To eliminate various artifacts from EEG signals, pre-processing is employed, such as utilizing a band-pass filter. Although an Auto-encoder layer is included, it has been found to decrease efficiency. The XGBoost Classifier is utilized to classify EEG signals into five EEG imagery tasks. This Deep Learning model is then pickled using Python and deployed to the server. The server prompts the development of a GUI that maps the input EEG signals to corresponding alphabets. The Neural Network is trained on multiple open-sourced EEG data-sets, utilizing various optimization algorithms to achieve high system accuracy and desirable efficiency for real-time applications. The textual output obtained can be utilized to aid in the rehabilitation of paralysis and stroke patients. The proposed hybrid model achieved an accuracy of 96.89% on testing data.while taking approximately 6 seconds per letter to be typed on the GUI screen.