Ten Years of the NRC Word-Emotion Association Lexicon
Ten years back, on May 8th 2010, with some anticipation and lots of excitement, Peter Turney and I introduced the NRC Word-Emotion Association Lexicon. So grateful that, over the years, so many people have put their hopes and trust in it. Such joy to see them boldly shine a light on the human condition — the positives and the negatives; not shying away even from sadness, fear, and anger.
Here are ten favorites to mark the ten years:
Note: This is an eclectic mix of serious academic research, innovative art, and amateur data analysis, created simply as a microcosm of the diverse uses of the emotion lexicon.
Note: The NRC Word-Emotion Association Lexicon (often shortened to NRC Emotion Lexicon, and originally called EmoLex) is a list of English words and their manually annotated associations with eight basic emotions (anger, fear, anticipation, trust, surprise, sadness, joy, and disgust) and two sentiments (negative and positive). Translations of the lexicon in other languages are available. The data and interactive visualizations are available through the project home page. You can also find other research projects on my webpage.
Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon
Saif Mohammad, Peter Turney. Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and…
1. Wishing Wall: An #Art Piece on Wishes and Hopes
Introduction of Wishing Wall, created by by Varvara and Mar:
Wishing Wall — Varvara & Mar
There is a number of traditions how to make a wish, for example, one should make a wish when blowing the candles on…
There are a number of traditions [on] how to make a wish, for example, one should make a wish when blowing the candles on birthday cake, when a year is changing, by throwing a coin in a fountain and much more. Making a wish is always connected to a magic, at the same time there is no visual manifestation nor any continuity after a wish is made.
Wishing Wall looks at re-imagining how we share our innermost wishes with the world. What if you could say your wish out loud and have it magically released into the world for people to see? In this piece spoken words are transformed into butterflies that are diverse in form and colour as they represent the sentiment of the spoken words.
Wishing Wall was displayed in the Barbican Centre London, Tekniska Museet Stockholm, Onassis Cultural Centre Athens, and Zorlu Centre Istanbul.
2. The Shapes of Stories
Years: 2011, 2014
There is no reason why the simple shapes of stories can’t be fed into computers. They are beautiful shapes.
— Kurt Vonnegut in his 1981 autobiography Palm Sunday
Tracking Emotions in Novels and Fairy Tales by Saif M. Mohammad
From Once Upon a Time to Happily Ever After: Tracking Emotions in Novels and Fairy Tales
Saif Mohammad. Proceedings of the 5th ACL-HLT Workshop on Language Technology for Cultural Heritage, Social Sciences…
Algorithm Tracks Literary Emotion in Shakespeare, the Brothers Grimm
Computers are excellent at crunching numbers, looking for words, following a logical set of instructions. But our…
Literary texts, such as novels, fairy tales, fables, romances, and epics have long been channels to convey emotions, both explicitly and implicitly…
In this paper, we show how sentiment analysis can be used in tandem with effective visualizations to quantify and track emotions in both individual books and across very large collections.
Matthew Jockers on the Relationship between Sentiment and Plot Arcs
Revealing Sentiment and Plot Arcs with the Syuzhet Package
For the past few years, I have been exploring the relationship between sentiment and plot shape in fiction. Earlier…
You may also be interested in this paper (that does not use EmoLex):
The emotional arcs of stories are dominated by six basic shapes
Advances in computing power, natural language processing, and digitization of text now make it possible to study a…
3. TransProse: Music that Captures the Emotional Arcs in Novels
Paper with Hannah Davis:
Generating Music from Literature
Hannah Davis, Saif Mohammad. Proceedings of the 3rd Workshop on Computational Linguistics for Literature (CLFL). 2014.
Music and literature have an intertwined past. It is believed that they originated together (Brown,1970), but in time, the two have developed into separate art forms that continue to influence each other. Music, just as prose, drama, and poetry, is often used to tell stories. Opera and ballet tell stories through music and words, but even instrumental music, which is devoid of words, can have a powerful narrative form (Hatten, 1991). Mahler’s and Beethoven’s symphonies, for example, are regarded as particularly good examples of narrative and evocative music (Micznik, 2001).
In this paper, for the first time, we present a method to automatically generate music from literature. Specifically, we focus on novels and generate music that captures the change in the distribution of emotion words.
Click to play the music:
This Is What Classic Novels Sound Like When a Computer Turns Them Into Piano Music
By picking out emotion-related words and translating those into tempos and keys, two researchers found a way to connect…
This symphony had both human and computer composers
Creative acts are one of the human race's defining characteristics. The ability to turn thoughts into music or art or…
Click to play the symphony orchestra, inspired by the music from TransProse, performed under the glass of the Louvre museum in Paris on Sept. 20, 2016.
4. Angry Trump, Happy Trump
Blog Post by by David Robinson:
Text analysis of Trump's tweets confirms he writes only the (angrier) Android half
I don't normally post about politics (I'm not particularly savvy about polling, which is where data science has had the…
this weekend I saw a hypothesis about Donald Trump’s twitter account that simply begged to be investigated with data: When Trump wishes the Olympic team good luck, he’s tweeting from his iPhone. When he’s insulting a rival, he’s usually tweeting from an Android. Is this an artifact showing which tweets are Trump’s own and which are by some handler?
Two people write Trump's tweets. He writes the angrier ones.
Recently, political and digital analysts began to suspect that Donald Trump's tweets are authored by two different…
5. Emotions in Poems
Paper with Will E. Hipson on understanding developmental trends through emotions in poems written by children:
PoKi: A Large Dataset of Poems by Children
Child language studies are crucial in improving our understanding of child well-being; especially in determining the…
Adults, adolescents, and even young children use language to make sense of their feelings and to share them with others (Lindquist et al., 2015)…
Children live rich and varied emotional lives. Over the course of development, the way children express, experience, and communicate their emotions changes (Bailen etal., 2019; Thompson, 1991). Understanding these changes is instrumental in promoting healthy socio-emotional functioning across all stages of development.
Paper on Poetry Generation by Brendan Bena and Jugal Kalita:
Introducing Aspects of Creativity in Automatic Poetry Generation
Poetry Generation involves teaching systems to automatically generate text that resembles poetic work. A deep learning…
A language generation system that can compose creative poetry
Over the past few decades, researchers have developed increasingly advanced artificial intelligence (AI) tools and…
6. City Maps with Sounds and Emotions
Chatty maps: constructing sound maps of urban areas from social media data
Studies have found that long-term exposure to urban noise (in particular, to traffic noise) results into sleeplessness…
Urban sound has a huge influence over how we perceive places. Yet, city planning is concerned mainly with noise, simply because annoying sounds come to the attention of city officials in the form of complaints, while general urban sounds cannot be easily captured at city scale. To capture both unpleasant and pleasant sounds, we propose a new methodology that relies on tagging information of georeferenced pictures.
From picture tags, we then study the relationship between soundscapes and emotions. We learn that streets with music sounds are associated with strong emotions of joy or sadness, while those with human sounds are associated with joy or surprise.
Project Page: Chatty Maps
An Emotional Map Of The City, As Captured Through Its Sounds
Imagine if instead of asking your realtor for a quiet street, you asked for one where you could hear laughter, birds…
7. hitchBOT: Attitudes Towards a Canadian Hitchhiking Robot
Paper with Kathleen Fraser, Frauke Zeller, David Smith, and Frank Rudzicz:
How do we feel when a robot dies? Emotions expressed on Twitter before and after hitchBOT's…
Abstract In 2014, a chatty but immobile robot called hitchBOT set out to hitchhike across Canada. It similarly made its…
In 2014, a chatty but immobile robot called hitchBOT set out to hitchhike across Canada. It similarly made its way across Germany and the Netherlands, and had begun a trip across the USA when it was destroyed by vandals. In this work, we analyze the emotions and sentiments associated with words in tweets posted before and after hitchBOT’s destruction to answer two questions: Were there any differences in the emotions expressed across the different countries visited by hitchBOT? And how did the public react to the demise of hitch-BOT?
8. Emotional Contagion
in Fake News Distributed via Twitter
Paper by Soroush Vosoughi, Deb Roy, Sinan Aral:
The spread of true and false news online
There is worldwide concern over false news and the possibility that it can influence political, economic, and social…
“Whereas false stories inspired fear, disgust, and surprise in replies, true stories inspired anticipation, sadness, joy, and trust.”
in YouTube Vlogs
Paper by H. Rosenbusch, A.M. Evans, and M. Zeelenberg:
Multilevel emotion transfer on YouTube: Disentangling the effects of emotional contagion and…
Why do connected users in online social networks express similar emotions? Past approaches have suggested situational…
The present analyses show two independent ways that emotions spread in the YouTube community. The first is an immediate emotion transfer that occurs when audience members watch a vlogger express emotions in a video. The second path is between average vlogger emotions (i.e., emotion averages over vlogs) and audience emotions, which materializes beyond the effect of the emotions in the vlog that is currently being watched. The two most popular interpretations of these two effects are emotional contagion for the immediate effect and similarity-based flocking (or homophily) for the sustained effect. Our analyses show that both effects, which were proposed in past psychological research, contribute independently to the apparent spread of emotions over social media. However, only the emotional contagion effect can really be labeled a spreading effect, as emotions are actually transferred from user to user. Homophily works the other way around by bringing users with similar emotions closer together. Thus, our models reveal that there is a spread of emotions as well as a “despread” (inching together) of similar users that lead to the observed correlations between the emotions of different people online.
Emotional Contagions Can Spread Like Wildfire Via YouTube
Do you subscribe to any YouTube channels? Do you feel especially simpatico with a particular YouTuber? Does the…
9. How Emotions and Code Interact
Analysis by Albert Ziegler:
Decoding Programmers: How Emotions Can Change Code - InformationWeek
A few weeks ago, I sat down at my desk in a horrible mood. I had taken the bus to work as usual, but on this ride I…
Happiness leads to productivity and vice versa.
Sadness leads to cleaner code. Anger leads to mistakes.
In the minds of many (and in no small part thanks to Hollywood movies), developers work effortlessly, hands flying across the keyboard as they write code with ruthless efficiency while munching salty snacks. Programming is a very abstract, even foreign, concept to many, but the work that developers do matters; it leads to stronger and faster applications, better software and a safer online world. Within this context, we must remember that the coders behind the machines are not machines themselves. Like any person, a developer’s work is affected by their mood and well-being, which can have serious ramifications.
10. Sad Songs and Angry Characters
Years: 2017, 2018
Saddest of the Radiohead Songs: by Charlie Thompson in 2017
Radiohead has been my favorite band for a while, so I am used to people politely suggesting that I play something "less…
Radiohead has been my favorite band for a while, so I am used to people politely suggesting that I play something “less depressing.” Much of Radiohead’s music is undeniably sad, and this post catalogs my journey to quantify that sadness, concluding in a data-driven determination of their most depressing song.
All Radiohead Songs Are Sad, but This Graph Shows Which Are the Saddest
I know what you're thinking: Every Radiohead song is sad. Well you're wrong! Data scientist Charlie Thompson has mapped…
Emotional Characters on Seinfeld
Just got to know this sad news:
Jerry Stiller, comedian and Seinfeld actor, dies at 92 | CBC News
Comedy veteran Jerry Stiller, who launched his career opposite wife Anne Meara in the 1950s and re-emerged four decades…
Turns out Frank Constanza was not the angriest on Seinfeld:
Analysis by Daniel Larson in 2018
Bonus Project: Word-Colour Associations
Years: 2011, 2020
Even the Abstract have Color: Consensus in Word-Colour Associations
Saif Mohammad. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language…
Colour is a vital component in the successful delivery of information, whether it is in marketing a commercial product (Sable and Akcay, 2010), in webdesign (Meier, 1988; Pribadi et al., 1990), or in information visualization (Christ, 1975; Card et al.,1999). Since real-world concepts have associations with certain colour categories (for example,danger with red, and softness with pink), complementing linguistic and non-linguistic information with appropriate colours has a number of benefits.
We created a large word–colour association lexicon… We observed that abstract concepts, emotions in particular, have strong colour associations… We found that frequencies of colour choice in associations follow the same order in which colour terms occur in language (Berlin and Kay, 1969).
This data study was a last-minute addition to piggyback over the emotion lexicon study. #BerlinAndKayColorTerms #linguisticrelativity
LexiChrome an interactive catalogue for scholars, designers, and writers (built on top of the word-color association lexicon) with Chris Kim, Christopher Collins, and Uta Hinrichs.
Lexichrome: Text Construction and Lexical Discovery with Word-Color Associations Using Interactive Visualization. Chris Kim, Uta Hinrichs, Saif M. Mohammad, and Christopher Collins. To appear in the Proceedings of DIS2020.
Feedback and Acknowledgments
Big thanks to everyone who has used the NRC Emotion Lexicon. Thanks to Peter Turney for being a great collaborator and source of inspiration. Thanks to Joel Martin for the support and encouragement to pursue work on the NRC Emotion Lexicon. Thanks also to the wonderful past and present colleagues at National Research Council Canada and the large vibrant community of Natural Language Processing researchers around the world for the thoughtful feedback and insightful suggestions.