Towards Using Visual Attributes to Infer Image Sentiment Of Social Events

View/ Open
Date
2017Author
Ahsan, Unaiza
De Choudhury, Munmun
Essa, Irfan
Metadata
Show full item recordAbstract
Widespread and pervasive adoption of smartphones has led to instant sharing of photographs that capture events ranging from mundane to life-altering happenings. We propose to capture sentiment information of such social event images leveraging their visual content. Our method extracts an intermediate visual representation of social event images based on the visual attributes that occur in the images going beyond sentiment-specific attributes. We map the top predicted attributes to sentiments and extract the dominant emotion associated with a picture of a social event. Unlike recent approaches, our method generalizes to a variety of social events and even to unseen events, which are not available at training time. We demonstrate the effectiveness of our approach on a challenging social event image
dataset and our method outperforms state-of-the-art approaches for classifying complex event images into sentiments.