QUAdriplegic esport
Research & development

Click here to find out how to download and play Cosmic Crashout!

Over the summer, our interns developed an EEG-based Esport game called Cosmic Crashout, allowing quadriplegic individuals to play games through various blinking patterns. Featuring a normal and hard blinking mode, players are able to navigate through the game for a chance to enter a global leaderboard. Our interns will focus on expanding the interface to more games, refining control options, and enhancing signal processing for improved accuracy and versatility in the future!

Abstract (9/7/2024)

Credits

Jill Luna Nomura: EEG Data Analysis Lead, Open BCI Integration Development Lead, Leaderboard Management Integration

Patrick McGrath: UI & Game Strategy Development Lead, BCI Interface Integration & Accessibility Development, Open BCI Integration Development

Joe Huber: BCI Interface Integration & Accessibility Development Lead, UI & Game Strategy Development, Quality Assurance Tester 2

Tommy Nguyen: EEG Headset Electronic Integration, Visual & Asset Development, Quality Assurance Tester

Joshua Nwabuzor: Visual & Asset Development, BCI Interface Integration & Accessibility Development

Mark Segal: UI & Game Strategy Development

Mathias Gutierrez: Sound Design

Daniel Belonio: UI & Game Strategy Development

Introduction

Quadriplegia is a type of paralysis affecting all four limbs and the body below the neck, typically resulting from spinal cord injuries. Individuals with quadriplegia face significant challenges, including limited mobility, communication difficulties, and accessibility issues, leading to substantial mental stress due to reliance on others for daily assistance. This project addresses these challenges by developing an EEG-based interface that allows quadriplegic individuals to engage in esports gaming. The developed game, Cosmic Crashout, is designed to be inclusive, enabling players to participate regardless of physical abilities. The game features two control modes, normal and hard blinking, allowing users to navigate menus, play, and input names for the global leaderboard.

Methodology

The system comprises key hardware and software components: the OpenBCI Ganglion board for EEG data collection, conductive gel to enhance signal quality, and real-time data streaming via the OpenBCI GUI. Software elements include the "socket" package for live data reception, "pygame" for game development, and the Google API for leaderboard management. Signal processing is performed by filtering FFT data from the headset to detect blinking patterns while excluding unconscious blinks. The EEG interface is integrated into the game using pygame, with controls synchronized to blinking patterns detected from the FFT data. Further technical details can be found in the ReadMe file available on our GitHub repository.

https://github.com/pvnet-technology-center/Cosmic-Crashout-Public

Results

Cosmic Crashout is the game designed by our development team for the Ganglion board, pioneering the use of this lesser-explored EEG system in gaming. The performance of the EEG interface depends on stable FFT plots and optimal impedance. The calibration screen enhances accuracy by tailoring hard blink detection to individual users, though consistent hardware accuracy remains a challenge. Maintaining a stable FFT plot in the OpenBCI GUI is crucial for optimal performance, as random spikes can disrupt gameplay. Compared to other assistive technologies, our interface, utilizing the OpenBCI Ganglion board with its four channels, offers a simpler yet novel approach. Future work may include expanding the interface to support more games, improving signal processing algorithms, increasing control options, and exploring alternative input methods such as SSVEP, P300, or motor control techniques, if feasible. These advancements could enhance the system's versatility and responsiveness, further improving the gaming experience for quadriplegic players.

Conclusion

Cosmic Crashout represents a significant milestone in making esports accessible to quadriplegic individuals through an EEG-based interface, filling a gap where such games have been largely absent. By employing the OpenBCI Ganglion board and integrating real-time signal processing, the project has effectively addressed key accessibility barriers, enabling a more inclusive gaming experience. This work underscores the potential of technology to enhance the quality of life for individuals with quadriplegia and paves the way for innovations that could transform the gaming industry, fostering more diverse and inclusive experiences for all players.