Publications
Paper in IJCNN (2017) on “Towards Using Visual Attributes to Infer Image Sentiment Of Social Events”
Paper Abstract Widespread and pervasive adoption of smartphones has led to the instant sharing of photographs that capture events ranging from mundane to life-altering happenings. We propose to capture sentiment information of such social event images leveraging their visual content. Our method extracts an intermediate visual representation of social event images based on the visual […]
Paper in IBSI 2014 conference entitled “Automated Surgical OSATS Prediction from Videos”
Abstract The assessment of surgical skills is an essential part of medical training. The prevalent manual evaluations by expert surgeons are time-consuming and often their outcomes vary substantially from one observer to another. We present a video-based framework for automated evaluation of surgical skills based on the Objective Structured Assessment of Technical Skills (OSATS) criteria. […]
Paper in AISTATS 2013 on “Beyond Sentiment: The Manifold of Human Emotions”
Sentiment analysis predicts the presence of positive or negative emotions in a text document. In this paper we consider higher-dimensional extensions of the sentiment concept, which represent a richer set of human emotions. Our approach goes beyond previous work in that our model contains a continuous manifold rather than a finite set of human emotions.
Paper in IROS 2012: "Linguistic Transfer of Human Assembly Tasks to Robots"
Citation Abstract We demonstrate the automatic transfer of an assembly task from human to robot. This work extends efforts showing the utility of linguistic models in verifiable robot control policies by now performing real visual analysis of human demonstrations to automatically extract a policy for the task. This method tokenizes each human demonstration into a […]
Paper (2011) in Virtual Reality on “Augmenting aerial earth maps with dynamic information from videos”
Augmenting aerial earth maps with dynamic information from videos Abstract We introduce methods for augmenting aerial visualizations of Earth (from tools such as Google Earth or Microsoft Virtual Earth) with dynamic information obtained from videos. Our goal is to make Augmented Earth Maps that visualize plausible live views of dynamic scenes in a city. We […]
Paper: ACM IWVSSN (2006) on “Unsupervised Analysis of Activity Sequences Using Event Motifs”
R. Hamid, S. Maddi, A. Bobick, I. Essa. “Unsupervised Analysis of Activity Sequences Using Event Motifs”, In proceedings of 4th ACM International Workshop on Video Surveillance and Sensor Networks (in conjunction with ACM Multimedia 2006). Abstract We present an unsupervised framework to discover characterizations of everyday human activities, and demonstrate how such representations can be […]