NEU 505 and CS 525: Special Topics
Brain-Computer Interaction

Schedule

(Subject to change)

Wednesday, Jan 12 | Introduction

Thursday, Jan 13

Pre-class Reading:

• REQUIRED pp. 299-321 and 355-359 (Chapters 1,2,3,4, 10): Erin T. Solovey and Felix Putze (2021), "Improving HCI with Brain Input: Review, Trends, and Outlook", Foundations and Trends in Human-Computer Interaction: Vol. 13: No. 4, pp 298-379. http://dx.doi.org/10.1561/1100000078
• Response required in discussion forum
• Sign up for research presentation date by Friday, Jan 17

Monday, Jan 17 | NO CLASS

• Select and post the paper you will present research presentation at least one week before your presentation.

Thursday, Jan 20

Pre-class Reading:

• REQUIRED: Fairclough, Stephen H. "Fundamentals of physiological computing." Interacting with Computers 21, no. 1-2 (2009): 133-145.
• Response required in discussion forum
• REQUIRED: Ramchurn, Richard, Sarah Martindale, Max L. Wilson, and Steve Benford. From Director's Cut to User's Cut: to Watch a Brain-Controlled Film is to Edit it." In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-14. 2019.
• Optional: Pike, Matthew, Richard Ramchurn, Steve Benford, and Max L. Wilson.# scanners: Exploring the control of adaptive films using brain-computer interaction." In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5385-5396. 2016.
• Optional: Ramchurn, R., Martinez Avila, J., Martindale, S., Chamberlain, A., Wilson, M.L. and Benford, S. Improvising a Live Score to an Interactive Brain-Controlled Film. In Proc. of NIME 2019. June 3-6, Porto Alegre, Brazil.
• Response required in discussion forum
• Presenter: Elaine Chen

Monday, Jan 24

Pre-class Reading:

• REQUIRED: Terasawa, Naoto, Hiroki Tanaka, Sakriani Sakti, and Satoshi Nakamura. "Tracking liking state in brain activity while watching multiple movies." In Proceedings of the 19th ACM International Conference on Multimodal Interaction, pp. 321-325. 2017.
• Optional: Lin, Yuan-Pin, Chi-Hong Wang, Tzyy-Ping Jung, Tien-Lin Wu, Shyh-Kang Jeng, Jeng-Ren Duann, and Jyh-Horng Chen. "EEG-based emotion recognition in music listening." IEEE Transactions on Biomedical Engineering 57, no. 7 (2010): 1798-1806.
• Optional: Duan, Lijuan, Huifeng Duan, Yuanhua Qiao, Sha Sha, Shunai Qi, Xiaolong Zhang, Juan Huang, Xiaohan Huang, and Changming Wang. "Machine learning approaches for MDD detection and emotion decoding using EEG signals." Frontiers in Human Neuroscience 14 (2020).
• Response required in discussion forum
• Presenter: Katy Nippert

• REQUIRED: Mustafa, Maryam, Stefan Guthe, Jan-Philipp Tauscher, Michael Goesele, and Marcus Magnor. "How Human Am I? EEG-based Evaluation of Virtual Characters." In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 5098-5108. 2017.
  • Optional: Cauchoix, Maxime, Gladys Barragan-Jason, Thomas Serre, and Emmanuel J. Barbeau. "The neural dynamics of face detection in the wild revealed by MVPA." Journal of Neuroscience 34, no. 3 (2014): 846-854.
  • Optional: Urgen, Burcu A., Alvin X. Li, Chris Berka, Marta Kutas, Hiroshi Ishiguro, and Ayse P. Saygin. "Predictive coding and the Uncanny Valley hypothesis: Evidence from electrical brain activity." Cognition: A Bridge between Robotics and Interaction (2015): 15-21.
  • Response required in discussion forum
  • Presenter: Will Wartman

Thursday, Jan 27

Pre-class Reading:

• REQUIRED: Shenoy, Pradeep, and Desney S. Tan. "Human-aided computing: Utilizing implicit human processing to classify images." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 845-854. 2008.
• Optional: Wang, Jun, Eric Pohlmeyer, Barbara Hanna, Yu-Gang Jiang, Paul Sajda, and Shih-Fu Chang. "Brain state decoding for rapid image retrieval." In Proceedings of the 17th ACM international conference on Multimedia, pp. 945-954. 2009.
• Optional: Kavasidis, Isaak, Simone Palazzo, Concetto Spampinato, Daniela Giordano, and Mubarak Shah. Brain2image: Converting brain signals into images." In Proceedings of the 25th ACM international conference on Multimedia, pp. 1809-1817. 2017.
• Response required in discussion forum
• Presenter: Ivan Martinovic

• REQUIRED: Yuksel, Beste F., Kurt B. Oleson, Lane Harrison, Evan M. Peck, Daniel Afergan, Remco Chang, and Robert JK Jacob. "Learn piano with BACh: An adaptive learning interface that adjusts task difficulty based on brain state." In Proceedings of the 2016 chi conference on human factors in computing systems, pp. 5372-5384. 2016.
• OPTIONAL: Gerjets, Peter, Carina Walter, Wolfgang Rosenstiel, Martin Bogdan, and Thorsten O. Zander. "Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach." Frontiers in neuroscience 8 (2014): 385.
• OPTIONAL: Nakic, Jelena, Andrina Granic, and Vlado Glavinic. "Anatomy of student models in adaptive learning systems: A systematic literature review of individual differences from 2001 to 2013." Journal of Educational Computing Research 51, no. 4 (2015): 459-489.
• Response required in discussion forum
• Presenter: Saniya Syeda

Monday, Jan 31

Pre-class Reading:

• REQUIRED: Skola, Filip, and Fotis Liarokapis. Examining and enhancing the illusory touch perception in virtual reality using non-invasive brain stimulation." In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-12. 2019.
• OPTIONAL: Choi, Woong, Liang Li, Satoru Satoh, and Kozaburo Hachimura. "Multisensory integration in the virtual hand illusion with active movement." BioMed research international 2016 (2016).
• OPTIONAL: Lopes, Pedro, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. "Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation." In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 1471-1482. 2017.
• Response required in discussion forum
• Presenter: Marc Capobianco

Thursday, Feb 3

Pre-class Reading:

• REQUIRED: Gilroy, Stephen William, Julie Porteous, Fred Charles, Marc Cavazza, Eyal Soreq, Gal Raz, Limor Ikar et al. "A brain-computer interface to a plan-based narrative." In Twenty-Third International Joint Conference on Artificial Intelligence. 2013.
• Optional: Aranyi, Gabor, Fred Charles, and Marc Cavazza. "Anger-based BCI using fNIRS neurofeedback." In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 511-521. 2015.
• Optional: "Affective interaction with a virtual character through an fNIRS brain-computer interface." Frontiers in computational neuroscience 10 (2016): 70.
• Response required in discussion forum
• Presenter: Tess Meier

Monday, Feb 7

• Project ideas discussion and brainstorming session

Thursday, Feb 10

Pre-class Reading:

• REQUIRED: Lampe, Thomas, Lukas DJ Fiederer, Martin Voelker, Alexander Knorr, Martin Riedmiller, and Tonio Ball. "A brain-computer interface for high-level remote control of an autonomous, reinforcement-learning-based robotic system for reaching and grasping." In Proceedings of the 19th international conference on Intelligent User Interfaces, pp. 83-88. 2014.
• OPTIONAL: Bryan, Matthew, Joshua Green, Mike Chung, Lillian Chang, Reinhold Scherer, Joshua Smith, and Rajesh PN Rao. "An adaptive brain-computer interface for humanoid robot control." In 2011 11th IEEE-RAS International Conference on Humanoid Robots, pp. 199-204. IEEE, 2011.
• OPTIONAL: Carlson, Tom, and Jose del R. Millan. "Brain-controlled wheelchairs: a robotic architecture." IEEE Robotics & Automation Magazine 20, no. 1 (2013): 65-73.
• Response required in discussion forum
• Presenter: Shanchao Wu

Monday, Feb 14

Pre-class Reading:

• REQUIRED: D'albis, Tiziano, Rossella Blatt, Roberto Tedesco, Licia Sbattella, and Matteo Matteucci. "A predictive speller controlled by a brain-computer interface based on motor imagery." ACM Transactions on Computer-Human Interaction (TOCHI) 19, no. 3 (2012): 1-25.
• Optional: Renton, Angela I., Jason B. Mattingley, and David R. Painter. "Optimising non-invasive brain-computer interface systems for free communication between naïve human participants." Scientific reports 9, no. 1 (2019): 1-18.
• Optional: Cao, Lei, Tianyu Liu, Lusong Hou, Zijian Wang, Chunjiang Fan, Jie Li, and Haoran Wang. "A novel real-time multi-phase BCI speller based on sliding control paradigm of SSVEP." IEEE Access 7 (2019): 133974-133981.
• Response required in discussion forum
• Presenter: Kai Zhang

Thursday, Feb 17

Pre-class Reading:

• REQUIRED: Semertzidis, Nathan, Michaela Scary, Josh Andres, Brahmi Dwivedi, Yutika Chandrashekhar Kulwe, Fabio Zambetta, and Florian Floyd Mueller. "Neo-Noumena: Augmenting Emotion Communication." In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1-13. 2020..
• Optional: Aldunate, Nerea, and Roberto González-Ibáñez. "An integrated review of emoticons in computer-mediated communication." Frontiers in psychology 7 (2017): 2061.
• Optional: Kosmyna, Nataliya, Chi-Yun Hu, Yujie Wang, Qiuxuan Wu, Cassandra Scheirer, and Pattie Maes. "A Pilot Study using Covert Visuospatial Attention as an EEG-based Brain Computer Interface to Enhance AR Interaction." In 2021 International Symposium on Wearable Computers, pp. 43-47. 2021.
• Response required in discussion forum
• Presenter: Duy Nguyen
• REQUIRED: Poli, Riccardo, Caterina Cinel, Ana Matran-Fernandez, Francisco Sepulveda, and Adrian Stoica. "Towards cooperative brain-computer interfaces for space navigation." In Proceedings of the 2013 international conference on Intelligent user interfaces, pp. 149-160. 2013.
• Optional: Curtin, Adrian, Hasan Ayaz, Yichuan Liu, Patricia A. Shewokis, and Banu Onaral. "A P300-based EEG-BCI for spatial navigation control." In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3841-3844. IEEE, 2012.
• Optional: Stawicki, Piotr, Felix Gembler, Roland Grichnik, and Ivan Volosyak. "Remote steering of a mobile robotic car by means of VR-based SSVEP BCI." In International Work-Conference on Artificial Neural Networks, pp. 406-417. Springer, Cham, 2019.
• Response required in discussion forum
• Presenter: Samantha Woodland

Monday, Feb 21

• Project proposal due

Pre-class Reading:

• REQUIRED: Midha, Serena, Horia A. Maior, Max L. Wilson, and Sarah Sharples. "Measuring mental workload variations in office work tasks using fNIRS." International Journal of Human-Computer Studies 147 (2021): 102580.
• Optional: Argyle, Elizabeth M., Adrian Marinescu, Max L. Wilson, Glyn Lawson, and Sarah Sharples. "Physiological indicators of task demand, fatigue, and cognition in future digital manufacturing environments." International Journal of Human-Computer Studies 145 (2021): 102522.
• Optional: Kosch, Thomas, Albrecht Schmidt, Simon Thanheiser, and Lewis L. Chuang. "One does not simply RSVP: mental workload to select speed reading parameters using electroencephalography." In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-13. 2020.
• Response required in discussion forum
• Presenter: Sandaljit Randhawa
• REQUIRED: Hachmeister, Nils, Hannes Riechmann, Helge Ritter, and Andrea Finke. "An approach towards human-robot-human interaction using a hybrid brain-computer interface." In Proceedings of the 13th international conference on multimodal interfaces, pp. 49-52. 2011.
• Optional: Riechmann, Hannes, Andrea Finke, and Helge Ritter. "Using a cVEP-based brain-computer interface to control a virtual agent." IEEE Transactions on Neural Systems and Rehabilitation Engineering 24, no. 6 (2015): 692-699.
• Optional: Chepin, E. V., A. A. Dyumin, G. A. Urvanov, and T. I. Voznenko. "The improved method for robotic devices control with operator's emotions detection." In 2016 IEEE NW Russia Young Researchers in Electrical and Electronic Engineering Conference (EIConRusNW), pp. 173-176. IEEE, 2016.
• Response required in discussion forum
• Presenter: Gabrielle Plainte

Thursday, Feb 24 | NO CLASS (Reading Day)

Monday, Feb 28

• Project presentation due
• Project idea presentations and discussions

Thursday, March 3

• Project idea presentations and discussions

March 5-13 | NO CLASS (Spring Break)

Monday, March 14 | NO CLASS

Thursday, March 17

• Project Draft Due

Monday, March 21

• Lab Tours: Neurotechnology Suite at PracticePoint and the Interaction Lab in Fuller Laboratories

Thursday, March 24

• Project Peer Reviews of Drafts due
• Sign up for Blog

Pre-class Reading:

• REQUIRED: Felix Putze, Susanne Putze, Merle Sagehorn, Christopher Micek, and Erin T. Solovey. 2021. Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse. ACM Trans. Comput.-Hum. Interact. (In Press), 41 pages
• Response required in discussion forum
• Guest Speaker: Christopher Micek, Ph.D. Student, Computer Science Department, WPI

Monday, March 28

Thursday, March 31

Pre-class Reading:

• REQUIRED: A. Bosworth, M. Russell, and R.J.K. Jacob, Update of fNIRS as an Input to Brain-Computer Interfaces: A Review of Research from the Tufts Human-Computer Interaction Laboratory," Photonics, Vol. 6(3) (2019) article no. 90.
• REQUIRED: L. Wang, Z. Huang, Z. Zhou, D.T. McKeon, G. Blaney, M.C. Hughes, and R.J.K Jacob, "Taming fNIRS-based BCI Input for Better Calibration and Broader Use," Proc. ACM UIST 2021 Symposium on User Interface Software and Technology (2021).
• REQUIRED: Draft proposal for discussion (4 pages)
• Optional: Z. Huang, L. Wang, G. Blaney, C. Slaughter, D.T. McKeon, Z. Zhou, R.J.K Jacob, and M.C. Hughes, "The Tufts fNIRS Mental Workload Dataset and Benchmark for Brain-Computer Interfaces that Generalize," Proc. NeurIPS 2021 Conference on Neural Information Processing Systems, Datasets and Benchmarks Track (2021).
• Response required in discussion forum
• Guest Speaker: Robert Jacob, Professor of Computer Science, Tufts University (Zoom)

Monday, April 4

• Demos of BrainEx and NAML

Thursday, April 7

• Blog Posts Due

Monday, April 11

Pre-class Reading:

• REQUIRED: Sommer, Natalie M., Burak Kakillioglu, Trevor Grant, Senem Velipasalar, and Leanne Hirshfield. "Classification of fNIRS Finger Tapping Data With Multi-Labeling and Deep Learning." IEEE Sensors Journal 21, no. 21 (2021): 24558-24569.
• REQUIRED: Additional article (in press) posted on Canvas
• Response required in discussion forum
• Guest Speaker: Leanne M. Hirshfield, Director of SHINE Lab and Associate Research Professor, Instiute of Cognitive Science, Univesity of Colorado Boulder

Thursday, April 14

Pre-class Reading:

• REQUIRED: Yuksel, Beste F., Kurt B. Oleson, Lane Harrison, Evan M. Peck, Daniel Afergan, Remco Chang, and Robert JK Jacob. "Learn piano with BACh: An adaptive learning interface that adjusts task difficulty based on brain state." In Proceedings of the 2016 chi conference on human factors in computing systems, pp. 5372-5384. 2016. [VIDEO]
• Optional: Peck, Evan M. M., Beste F. Yuksel, Alvitta Ottley, Robert JK Jacob, and Remco Chang. "Using fNIRS brain sensing to evaluate information visualization interfaces." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 473-482. 2013.
• REQUIRED: Yuksel, Beste F., Michael Donnerer, James Tompkin, and Anthony Steed. "A novel brain-computer interface using a multi-touch surface." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 855-858. 2010.
• Response required in discussion forum
• Guest Speaker: Beste Filiz Yuksel, University of San Francisco

Monday, April 18 | NO CLASS

• Patriots' Day Holiday

Thursday, April 21

• REQUIRED: Vortmann, Lisa-Marie, Felix Kroll, and Felix Putze. "EEG-based classification of internally-and externally-directed attention in an augmented reality paradigm." Frontiers in human neuroscience (2019): 348.
• REQUIRED: Putze, Felix, Tilman Ihrig, Tanja Schultz, and Wolfgang Stuerzlinger. "Platform for Studying Self-Repairing Auto-Corrections in Mobile Text Entry based on Brain Activity, Gaze, and Context." In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-13. 2020.
• Response required in discussion forum
• Guest Speaker: Felix Putze, University of Bremen

Monday, April 25

• Project Final Writeup Due

Pre-class Reading:

• REQUIRED: Kosmyna, Nataliya, Alexandra Gross, and Pattie Maes. The thinking cap 2.0: preliminary study on fostering growth mindset of children by means of electroencephalography and perceived magic using artifacts from fictional sci-fi universes. In Proceedings of the Interaction Design and Children Conference, pp. 458-469. 2020.
• REQUIRED: Kosmyna, Nataliya, and Anatole Lecuyer. "A conceptual space for EEG-based brain-computer interfaces." PloS one 14, no. 1 (2019): e0210145.
• Response required in discussion forum
• Guest Speaker: Nataliya Kos'myna, MIT Media Lab

Thursday, April 28

Pre-class Reading:

• REQUIRED: Basu, Ishita, Ali Yousefi, Britni Crocker, Rina Zelmann, Angelique C. Paulk, Noam Peled, Kristen K. Ellard et al. "Closed-loop enhancement and neural decoding of cognitive control in humans." Nature Biomedical Engineering (2021): 1-13.
• Optional: Arefnezhad, Sadegh, James Hamet, Arno Eichberger, Matthias Frühwirth, Anja Ischebeck, Ioana Victoria Koglbauer, Maximilian Moser, and Ali Yousefi. "Driver drowsiness estimation using EEG signals with a dynamical encoder-decoder modeling framework." Scientific reports 12, no. 1 (2022): 1-18.
• Optional: Yousefi, Ali, Ishita Basu, Angelique C. Paulk, Noam Peled, Emad N. Eskandar, Darin D. Dougherty, Sydney S. Cash, Alik S. Widge, and Uri T. Eden. "Decoding hidden cognitive states from behavior and physiology using a bayesian approach." Neural computation 31, no. 9 (2019): 1751-1788.
• Response required in discussion forum
• Guest Speaker: Ali Yousefi, Assistant Professor, Computer Science Department (and Neuroscience, BCB Programs), WPI

Monday, May 2

• Final Project Virtual Conference | No in-person class