About the Lab

Our lab aim designs and develops novel artificial intelligence (AI) techniques for interactive intelligent systems that leverage knowledge of how people behave around them and are supported by user studies. Using these algorithms, intelligent systems can tailor their functionality by learning actual use patterns and user preferences to improve performance metrics such as task completion time, accuracy, usability, understandability, and predictability.

Interested students are always welcome and should contact
Stephanie Rosenthal (srosenth at andrew dot cmu dot edu).

Explainable AI and Robotics

Sai Selvaraj, Stephanie Rosenthal, Manuela Veloso. “Classifier Labels as Language Grounding for Explanations.” Global Conference on Artificial Intelligence, August 2018.[pdf]

Sai Selvaraj, Stephanie Rosenthal, Manuela Veloso. “Classifier-Based Evaluation of Image Feature Importance.” Global Conference on Artificial Intelligence, August 2018.[pdf]

Sai Selvaraj, Stephanie Rosenthal, Manuela Veloso. “Vision-Based Robot State Explanation”. Workshop on Explainable Robots, Human Robot Interaction (HRI), March 2018.

Eleanor Avrunin, Stephanie Rosenthal, Reid Simmons. “Coverage-Based Policy Explanations”. Workshop on Explainable Robots, Human Robot Interaction (HRI), March 2018.

Sandeep Konam, Ian Quah, Stephanie Rosenthal, Manuela Veloso. "Understanding Convolutional Networks with APPLE: Automatic Patch Pattern Labeling for Explanation." AI, Ethics and Society Conference (in conjunction with AAAI), February 2018.[pdf]

Shen Li, Rosario Scalise, Henny Admoni, Siddhartha S. Srinivasa, Stephanie Rosenthal. "Evaluating Critical Points in Trajectories", Robot-Human Communication, pgs. 1357-1364, August 2017. [pdf]

Sandeep Konam, Benjamin J. Lengerich, Eric P. Xing, Stephanie Rosenthal, Manuela Veloso. "Towards Visual Explanations for Convolutional Neural Networks via Input Resampling", Workshop on Visualization for Deep Learning, International Conference on Machine Learning (ICML), August 2017.

Vittorio Perera, Sai P. Selveraj, Stephanie Rosenthal, Manuela Veloso. "Dynamic Generation and Refinement of Robot Verbalization", Robot-Human Communication, August 2016. [pdf]

Kim Baraka, Stephanie Rosenthal, and Manuela Veloso. "Enhancing Human Understanding of a Mobile Robot's State and Actions using Expressive Lights", Robot-Human Communication, August 2016. [pdf]

Shen Li, Rosario Scalise, Henny Admoni, Stephanie Rosenthal, Siddhartha S. Srinivasa. "Spatial References and Perspective in Natural Language Instructions for Collaborative Manipulation", Robot-Human Communication, August 2016. [pdf]

Stephanie Rosenthal, Sai P. Selvaraj, Manuela Veloso. "Verbalization: Narration of Autonomous Mobile Robot Experience." in Proc. 26th International Joint Conference on Artificial Intelligence (IJCAI 2016), July 2016. [pdf]

Asking For Help

Stephanie Rosenthal, Manuela Veloso, Anind K. Dey. "Acquiring Accurate Human Responses to Robots' Questions." In Journal of Social Robotics, Volume 4(2), 2012, pages 117-129. (Springer Online)

Stephanie Rosenthal, Manuela Veloso, Anind K. Dey. "Is Someone in this Office Available to Help Me? Proactively Seeking Help from Spatially-Situated Humans." In Journal of Intelligent and Robotic Systems, Special Issue on Domestic Service Robots in the Real World, Volume 66(1-2), 2012, pages 205-221. (Springer Online)

Manuela Veloso, Joydeep Biswas, Brian Coltin, Stephanie Rosenthal "CoBots: Robust Symbiotic Autonomous Mobile Service Robots." in Proc. 25rd International Joint Conference on Artificial Intelligence (IJCAI 2015), July 2015. [pdf]

Stephanie Rosenthal, Dan Bohus, Ece Kamar, Eric Horvitz. "Look vs Leap: Value of Information with Streaming Evidence." in Proc. 23rd International Joint Conference on Artificial Intelligence (IJCAI 2013), August 2013. [pdf]

Stephanie Rosenthal, Manuela Veloso. "Monte Carlo Preference Elicitation for Learning Additive Reward Functions." in Proc. IEEE Symposium on Robot and Human Interactive Communication (RO-MAN 2012), pgs. 886-891, September 2012. [pdf]

Stephanie Rosenthal, Manuela Veloso. "Mobile Robot Planning to Seek Help with Spatially-Situated Tasks." In Proc. Twenty-Sixth Conference on Artificial Intelligence (AAAI 2012), pgs. 2067-2073, July 2012. [pdf]

Stephanie Rosenthal, Manuela Veloso, Anind K. Dey. "Learning Accuracy and Availability of Humans who Help Mobile Robots." In Proc. Twenty-Fifth Conference on Artificial Intelligence (AAAI 2011) Special Track on Physically Grounded Artificial Intelligence, pgs. 1501-1506, August 2011. [pdf]

Stephanie Rosenthal, Manuela Veloso. "Modeling Humans as Observation Providers using POMDPs." In Proc. International Symposium on Robot-Human Communication (Ro-Man 2011), pgs. 53-58, July 2011. [pdf]

Stephanie Rosenthal, Anind K. Dey, Manuela Veloso. "Using Decision-Theoretic Experience Sampling to Build Personalized Mobile Phone Interruption Models." In Proc. International Conference on Pervasive Computing (Pervasive 2011), pp. 170-187, June 2011. [pdf]

Stephanie Rosenthal, Shaun K. Kane, Jacob O. Wobbrock, Daniel Avrahami. "Augmenting On-Screen Instructions with Micro-Projected Guides: When it Works and When it Fails." in Proc ACM International Conference on Ubiquitous Computing (Ubicomp 2010), pp. 203-212, September 2010. [pdf]

Stephanie Rosenthal, Joydeep Biswas, Manuela M. Veloso. "An Effective Personal Mobile Robot Agent Through Symbiotic Human-Robot Interaction." in Proc International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), pp. 915-922, May 2010. [pdf]

Stephanie Rosenthal and Anind K. Dey. "Towards Maximizing the Accuracy of Human-Labeled Sensor Data." in Proc International Conference on Intelligent User Interfaces (IUI 2010), pp. 259-268. February 2010. [pdf]

Stephanie Rosenthal, Anind K. Dey, Manuela Veloso. "How Robots' Questions Affect the Accuracy of the Human Responses." in Proc. Internatinal Symposium on Robot-Human Interactive Communication (Ro-Man 2009), pp. 1137-1142, September 2009. [pdf]

Supporting Data Scientists and Improving Analytics

Julian Andres Ramos Rojas, Mary Beth Kery, Stephanie Rosenthal, Anind Dey. "Sampling Techniques to Improve Big Data Exploration," Symposium on Large Data Analysis and Visualization (in conjunction with IEEE VIS), pgs. 26-35, October 2017.pdf

Sz-Rung Shiang, Stephanie Rosenthal, Anatole Gershman, Jaime Carbonell, Jean Oh. "Vision-Language Fusion for Object Recognition", In Proc. Thirty-First Conference on Artificial Intelligence (AAAI 2017), February 2017. [pdf]

Stephanie Rosenthal, Scott McMillan, Matthew Gaston. "Developer toolchains for large-scale analytics: Two case studies." In Proc. International Conference on Big Data (Big Data 2015): pgs 1311-1316, October 2015. [pdf]

Securing Analytics

Stephanie Rosenthal. “Anonymity and Linguistic Obfuscation.” Workshop on Deception and Artificial Intelligence, August 2018.

Stephanie Rosenthal, Andrew Mellinger, David Shepard, Eric Werner, Matthew Gaston. "Attacking Analytics: Is our Big Data at Risk?". Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium on Cognitive Security, March 2014.

Get In Touch.

Contact Details

Stephanie Rosenthal
Carnegie Mellon University
Pittsburgh, PA
Appointments required

srosenth at andrew dot cmu dot edu