Design, Behavior & Social Interaction

An investigation in human communication across physical and digital methods.

Initial Concept

This project investigates the similarities and differences between ‘physical’ and digital well-being, specifically whether real-world events and emotions can be reflected and translated effectively via digital communication methods (e.g. through emoticons). Through identified observations and patterns, I hope to make meaning of them and establish a stronger sense of direction for the next steps.


Beginnings of Emojis

ASCII Art

ASCII art was the original source of graphical representation using text characters, until emoticons were popularized by Fahlman (CMU researcher) in 1982, when he proposed the use of :-) and :-(. Today, we see a range of emoji designs along with “reactions” available on many social media platforms, especially Facebook.


Psychology of Emojis

Psychologist World

“the meaning that one person associates with an emoticon can be lost on — even completely different to — the reader’s understanding of it.”
voice modulation, intonation and the nuances of body language, which tend to convey our emotions, are lost in text messaging, where the written word is the only available medium to express ourselves.”
“A limited choice of emoticons restricts the range of emotions that we can express, and does not allow for the subtle nuances or strengths of emotion that we experience. Facebook’s ‘reactions’ feature, for example, restricts a user’s responses to one of just six emojis — a varied but incomplete representation of feelings. Both emoticons and emotions also reduce the need to develop the written skills needed to express oneself in the absence of such shorthand forms of communication.”

CNN

Emojis providing more context to developing appropriate responses.

Emoji Literature

An example of effective graphical literature in Xu Bing’s book — I’ve found that reading it aloud with peers enriches the experience.

Book from the Ground

Designing A Brief Interview

To kickoff the project and gather some quick observations and patterns, I decided to interview 4 designers. The first part of the interview consisted of a casual conversation around how their past week has been, and if they could share 3 highlights and 3 lowlights. The second part was looking at their frequently used emojis and have them describe the contexts in which they were used. We also end with discussing whether there were correlations between certain emojis and the week’s events, and their thoughts on the effectiveness of emojis in conveying their emotions.


Interview Results

Designer A

Designer A —

Past week: Quite happy, if had to be numerical (80% positivity). The major interactions they had surround group in-person interactions. Digitally, the emojis used represent casual reactions they have during positive scenarios. They refrain from using emojis for the negative, as they dislike gamifying important situations and lessening the seriousness. Though finds it useful to add emojis when wanting to make others feel less bad.

😅: awkward smile; usually trying to justify something e.g. “sorry I’m late”

😂: great for jokes and memes

😆: great for jokes and memes

😁: an universal smile applicable for most people

👋: “hi” gesture for nicer, quirkier impression


Designer B

Designer B —

Past week: Not quite as positive as usual (30% positivity). Major highlights surrounded group social interactions from gatherings and class, to feeling good about time management. Lowlights considered mostly negative internal feelings, lack of conversation with family. They tend to use 5 or 6 emojis at a time to create exaggerated, first hand reactions — often sarcastic/for trolls. Prefer having serious conversations via phone or text (without emojis).

💖: tackier version of original heart, feels more sparkly and special

❤️: heart for more casual settings

💕: fun hearts to change things up

💃🏾: likes the match of skin color, having fun

😍: used when showing appreciation for things


Designer C

Designer C—

Past week: Quite positive week (60% positivity). Highlights again surrounded having meaningful social interactions with friends, whether in-person or via phone call. Lowlights ranged from technical difficulties, to feelings of danger when exploring town. They tend to text only in positive scenarios, though keeps emoji use light, as texting feels only appropriate for surface level things; hard to form real relationships via text. For serious situations, tend to rely on Facetime audio calls.

❤️: lots of love everywhere

🙃: upside-down smiley feels quirky and dynamic, not just a simple individual

😊: enjoys rosy cheeks smiley as feels there is physical resemblance with self

🤤: drooling emote feels offensive, kind of enjoy it

👌🏼: ‘ok’ a lot


Designer D

Designer D—

Past week: Quite positive week (60% positivity). Highlights surrounded balance in satisfaction across work, hanging out with friends, and enjoyment of weather. Lowlights surrounded negative internal feelings of readjustment in terms of stress and time management. They refrain from using emojis during negative scenarios, as they feel it breaks seriousness. However, often finds it useful in de-stressing situations.

😂👍😁😊👌: tend to be best for group chats, enjoys playing with racially diverse emojis, joking around and being sarcastic

💪: likes how flexible flex emoji is, can be used in many scenarios from encouraging others to working out


Interview Findings

Emojis can be used as….

  • Conflict diffusers — often used to make situation less serious, particularly helpful in group scenarios
  • Response dictators — suggestive of how people should react to a message (same textual elements, different emojis can generate different responses)
  • Indicator of positive engagements — emojis tend not to be used during lowlights/serious scenarios

Project Directions

Critique from Peers & Dan

  • What are underlying definitions and functions of emojis?
  • What are the limitations of emojis? Can we design a way to better communicate?
  • Unicode guidelines?
  • Create a communication feature?

Further Investigations

  • How can we translate more effective elements in communication to the digital space?
  • Can emojis, or graphic text be more genuine?
  • Can we leverage typing speed, finger pressure, gaze and chat-use time, and translate these forms of data into moods/feelings for others?
  • Should others be able to better understand your thinking behind the screen?
  • Changing colors of chat rooms that reflect mood/feelings?
  • Enjoyment of conversations/relationships — presence. How to recreate feelings of presence? Reducing features such as ‘active X hours ago’ + ‘read’ messages that’s suggestive of a ‘bad friend’?


Speculations of the Future in Texting

  • Texting by thinking

Further Peer Discussion

  • Replicating haptic/typing data through text? E.g. animating text based on speed of typing, scaling words based on punctuation…
  • > Haptic ‘reacts’ as option — sending friends temperature, vibration, etc. or in future AR/VR adaptations, send hugs, pats, 360 all around sound messages, etc.
  • Do people want more transparency in the feelings of people they’re talking to?
  • Can we send invitations for people to opt-in to ‘serious’ conversations? How do we design spaces for serious, real relationship building?
  • Location — when app knows you’re somewhere else, makes recommendations to catch up with people?
  • Technology as a middle man for ‘people planning’?
  • Though some may argue texts are less dynamic
Like what you read? Give Jessica Nip a round of applause.

From a quick cheer to a standing ovation, clap to show how much you enjoyed this story.