Sooyeon Lee
Assistant Professor, Informatics
- sooyeon.lee@njit.edu
- 973-596-5455
- 3901A Guttenberg Information Technologies Center (GITC)
Education
Ph.D.; Pennsylvania State University-Main Campus; Information Sciences and Technology (Human-Computer Interaction); 2020
B.S.; Pennsylvania State University-Main Campus; Information Sciences and Technology; 2008
2026 Fall Courses
IS 375 - DISCOVERING USER NEEDS FOR UX
IS 491 - SENIOR PROJECT - IS
IS 701B - MASTER'S THESIS
IS 776 - IS RESEARCH STUDY
IT 488 - INDEPENDENT STUDY
IS 489 - INFO UNDERGRAD THESIS RESEARCH
IS 790A - DOCT DISSERTATION & RES
IS 488 - INDEPENDENT STUDY IN INFO
IS 700B - MASTER'S PROJECT
IS 725 - INDEPENDENT STUDY I
IS 726 - INDEPENDENT STUDY II
IS 792 - PRE-DOCTORAL RESEARCH
Past Courses
IS 247: DESIGNING THE USER EXPERIENCE
IS 375: DISCOVERING USER NEEDS FOR UX
Journal Article
Lloyd May, Michael Clemens, Khang Dang, Keita Ohshiro, Sripathi Sridhar, Pauline Wee, Magdalena Fuentes, Sooyeon Lee, Mark Cartwright. 2025. "“Choices? That's the dream”: challenges and opportunities in non-speech information closed-captioning." Frontiers in Computer Science, vol. 7.
Sooyeon Lee, Nelson Daniel Troncoso Aldas, Chonghan Lee, Mary Beth Rosson, John M Carroll, Vijaykrishnan Narayanan. 2022. "AIGuide: Augmented reality hand guidance in a visual prosthetic." ACM Transactions on Accessible Computing (TACCESS), vol. 15, no. 2, pp. 1--32.
Saad Hassan, Matthew Seita, Larwan Berke, Yingli Tian, Elaine Gale, Sooyeon Lee, Matt Huenerfauth. 2022. "ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworks." arXiv preprint arXiv:2207.04021.
Akhter Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, Sooyeon Lee, Matt Huenerfauth. 2022. "Deaf and Hard of Hearing Viewers’ Preference for Speaker Identifier Type in Live TV Programming." .
Jingyi Xie, Rui Yu, Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M Carroll. 2022. "Feasibility of Interactive 3D Map for Remote Sighted Assistance." arXiv preprint arXiv:2202.01365.
Jingyi Xie, Madison Reddie, Sooyeon Lee, Syed Billah, Zihan Zhou, Chun-hua Tsai, John Carroll. 2022. "Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance." ACM Transactions on Computer-Human Interaction.
Oliver Alonzo, Lisa Elliot, Becca Dingman, Sooyeon Lee, Akhter Al Amin, Matt Huenerfauth. 2022. "Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals in the US: Their Reading Experiences, Interests and Perceptions of Social Accessibility." ACM Transactions on Accessible Computing (TACCESS).
Sooyeon Lee, Madison Reddie, John M Carroll. 2021. "Designing for Independence for people with visual impairments." Proceedings of the ACM on Human-Computer Interaction, vol. 5, no. CSCW1, pp. 1--19.
John M Carroll, Sooyeon Lee, Madison Reddie, Jordan Beck, Mary Beth Rosson. 2020. "Human-Computer Synergies in Prosthetic Interactions.." IxD\&A, vol. 44, pp. 29--52.
Chien Wen Yuan, Benjamin V Hanrahan, Sooyeon Lee, Mary Beth Rosson, John M Carroll. 2019. "Constructing a holistic view of shopping with people with visual impairment: a participatory design approach." Universal Access in the Information Society, vol. 18, pp. 127--140.
Sooyeon Lee, Madison Reddie, Krish Gurdasani, Xiying Wang, Jordan Beck, Mary Beth Rosson, John M Carroll. 2018. "Conversations for Vision: Remote Sighted Assistants Helping People with Visual Impairments." arXiv preprint arXiv:1812.00148.
Chien Wen Yuan, Benjamin V Hanrahan, Sooyeon Lee, Mary Beth Rosson, John M Carroll. 2017. "I didn't know that you knew I knew: Collaborative shopping practices between people with visual impairment and people with vision." Proceedings of the ACM on Human-Computer Interaction, vol. 1, no. CSCW, pp. 1--18.
Peter A Zientara, Sooyeon Lee, Gus H Smith, Rorry Brenner, Laurent Itti, Mary B Rosson, John M Carroll, Kevin M Irick, Vijaykrishnan Narayanan. 2017. "Third eye: A shopping assistant for the visually impaired." Computer, vol. 50, no. 2, pp. 16--24.
Kyungsik Han, Richard Wirth, Benjamin V Hanrahan, Jiawei Chen, Sooyeon Lee, John M Carroll. 2016. "Being connected to the local community through a festival mobile application." IConference 2016 Proceedings.
Chien Wen Yuan, Benjamin V Hanrahan, Sooyeon Lee, John M Carroll. 2015. "Designing Equal Participation in Informal Learning for People with Visual Impairment.." IxD\&A, vol. 27, pp. 93--106.
Conference Paper
"Towards a Rich Format for Closed-Captioning"
Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), October (4th Quarter/Autumn), 2024.
Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), October (4th Quarter/Autumn), 2024.
Conference Proceeding
"Unspoken Sound: Identifying Trends in Non-Speech Audio Captioning on YouTube"
ACM, May, 2024.
ACM, May, 2024.
"Are Two Heads Better than One? Investigating Remote Sighted Assistance with Paired Volunteers"
2023.
2023.
"Opportunities for Accessible Virtual Reality Design for Immersive Musical Performances for Blind and Low-Vision People"
2023.
2023.
"Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News"
2023.
2023.
"Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing Users"
2023.
2023.
"A Dataset of Word-Complexity Judgements from Deaf and Hard-of-Hearing Adults for Text Simplification"
2022.
2022.
"Analyzing Deaf and Hard-of-Hearing Users’ Behavior, Usage, and Interaction with a Personal Assistant Device that Understands Sign-Language Input"
2022.
2022.
"Design and evaluation of hybrid search for american sign language to english dictionaries: Making the most of imperfect sign recognition"
2022.
2022.
"Helping helpers: Supporting volunteers in remote sighted assistance with augmented reality maps"
2022.
2022.
"Methods for evaluating the fluency of automatically simplified texts with deaf and hard-of-hearing adults at various literacy levels"
2022.
2022.
"Opportunities for human-AI collaboration in remote sighted assistance"
2022.
2022.
"Remotely co-designing features for communication applications using automatic captioning with deaf and hearing pairs"
2022.
2022.
"Support in the Moment: Benefits and use of video-span selection and search for sign-language video comprehension among ASL learners"
2022.
2022.
"Understanding ASL Learners’ Preferences for a Sign Language Recording and Automatic Feedback System to Support Self-Study"
2022.
2022.
"Watch It, Don’t Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers"
2022.
2022.
"YouTube Videos as Data: Seeing Daily Challenges for People with Visual Impairments During COVID-19"
2022.
2022.
"American sign language video anonymization to support online participation of deaf and hard of hearing users"
2021.
2021.
"At a different pace: Evaluating whether users prefer timing parameters in american sign language animations to differ from human signers’ timing"
2021.
2021.
"AIGuide: An augmented reality hand guidance application for people with visual impairments"
2020.
2020.
"The emerging professional practice of remote sighted assistance for people with visual impairments"
2020.
2020.
"Understanding and designing for deaf or hard of hearing drivers on Uber"
2019.
2019.
"OneNote Meal: A photo-based diary study for reflective meal tracking"
2018.
2018.
"Reaching out: Investigating different modalities to help people with visual impairments acquire items"
2017.
2017.
"The third eye: A shopping assistant for the visually impaired"
2017.
2017.
"'Masterful'matchmaking in service transactions: Inferred abilities, needs and interests versus activity histories"
2016.
2016.
"Attracting intra-marginal traders across multiple markets"
2009.
2009.
"Impact of misalignment of trading agent strategy across multiple markets"
2009.
2009.