Theory of Mind AI: Are Goals and Actions Driven by Emotions?

How can emotions be harnessed to enhance AI-driven behaviors and outcomes?

Ivan Markočič
10 min readFeb 8, 2023
Image created by Author using Stable Diffusion

Overview

Emotions play a crucial role in the human experience, providing depth and richness to our lives and our sense of self. They allow us to connect with the world and others in a deeper and more meaningful way. Without emotions, our experiences would be flat and limited. Every emotion, whether it be joy, love, anger, or any other, has a profound impact on shaping our lives and the person we become.

While some people believe that humans will always be superior in experiencing emotions compared to machines, recent developments in emotional AI are challenging this view. Emotions are not just simple feelings, they play a crucial role in shaping our attitudes and behaviors towards things. Emotions can be measured as numerical values, calculated based on the benefit or harm ratio over short, medium, or long-term time frames.

Selecting goals and actions based on emotions can be a difficult task, however, it is imperative for improving our behavior. There are several techniques for selecting behavior based on emotions, including both innate and learned from personal experiences. Each potential behavior must be evaluated for its impact on motivational parameters, and the most effective one, if any, is selected for implementation.

Making decisions about our behavior towards a certain entity based on emotions is fast and effective, making it the preferred option, especially when we don’t have the time to consider other factors. Emotions are not intended for philosophical purposes, such as providing depth and meaning to our lives, but rather they are designed to increase our chances of survival.

By utilizing the estimated value of emotions, AI agents can make more informed and effective decisions for achieving desired outcomes, particularly in the fields of robotics and automation, healthcare, marketing and advertising, education, and customer service.

The Importance of the Theory of Mind in Social Interactions

The Theory of Mind, the capability of the human brain to ascribe mental states to others, is a critical aspect of hot cognition. This skill enables humans to engage in meaningful interactions with each other and is crucial for social interaction. It gives us the ability to comprehend and anticipate the actions of others by assigning to them motives, beliefs, wants, objectives, and other mental states. This capacity is vital for social cooperation.

Theory of Mind-Level AI: Enhancing Interaction and Advancements

The concept of “theory of mind-level AI” refers to an artificial intelligence system that can understand human mental states such as beliefs, desires, and intentions. This could greatly enhance AI’s interaction with humans, leading to significant advancements in the field. For instance, this type of AI could be used to develop robots with the ability to show empathy and even exhibit moral behavior. Furthermore, a deeper understanding of human mental states could help AI systems make fewer mistakes and carry out tasks more effectively.

Exploring the 8 Primary Emotions and Their Combinations

Emotions play a crucial role in our human experience, shaping how we feel and interact with the world around us. According to Plutchnik, there are 8 primary emotions that are innate, universal, and appear soon after birth. These emotions form the basis of all other emotions and are present in all cultures.

Emotion classification. (2023, February 6). In Wikipedia. https://en.wikipedia.org/wiki/Emotion_classification

While there are many other theories that explain emotions, for our purpose, we will stick to Plutchik’s theory of emotions for now.

Primary Emotions

The 8 primary emotions come in pairs, each with an opposite emotion. The pairs are:

  • Joy and Sadness
  • Fear and Anger
  • Anticipation and Surprise
  • Disgust and Trust

Each pair of emotions has a different physiological response. For example, when experiencing joy, the physiology is to connect with others, while with sadness, it is to withdraw.

Combinations of Emotions

In addition to the primary emotions, there are also combinations of two or more primary emotions. For example, joy and trust combine to form love, while anticipation and joy combine to form optimism. Emotions can also be complex and made up of multiple distinct feelings.

There are also tertiary feelings, which are a combination of three or more primary emotions. The complexity of emotions allows for a wide range of feelings and experiences.

Goals and Actions Driven by Emotions

Reflect on your objective. What is it that you desire to attain? Is it a short-term or a long-term goal? How determined are you to reach it?

Your motivation level will greatly depend on your emotions. Emotions can be a powerful motivator in reaching your goals. If you feel positive and confident about your goal, you are more likely to make the effort to achieve it. On the other hand, if you feel negative and unsure, it will be more challenging to stay focused.

It is crucial to be truthful with yourself about your emotions. If you are uncertain, take some time to reflect on them and determine what is causing them. Are you experiencing fear or excitement? Once you understand your emotions, you can start to work on controlling them.

If you find yourself doubting your ability to reach your goal, focus on the positive. Think about what you have already achieved and what you are capable of. Keep in mind that you can always adjust your goal if necessary. And most importantly, don’t give up!

The emotions of the agent must be related to their goals through multi-output regression. This will result in multiple goals that are weighted according to the agent’s emotions.

Goals Evaluation

The Importance of Voting on Goals

Voting on our goals is a crucial step in determining what we want to achieve in life. Our goals are influenced by a combination of physical needs, emotions, and desires.

Physical Needs

Physical needs are the bare minimum requirements we need to survive. They include air, food, and water. These needs are of utmost importance and always come first.

Emotions and Desires

Our emotions and desires are also influential in determining our goals. Emotions such as happiness, sadness, or anger can impact our decisions. Desires, on the other hand, are things we want but don’t necessarily need, like a new car or a trip to the moon.

Combining the Three

To determine our goals, we weigh the importance of our physical needs, emotions, and desires by voting. Physical needs are given higher weight if they are close to the threshold. This is because if we don’t have our basic needs met, we won’t be able to survive.

An example of this is when we are feeling hungry and come across a young lion. Our physical need for food is in conflict with our emotion of fear. However, if the hunger becomes too intense, we may be willing to overcome our fear and attack the lion to satisfy our need for food.

Voting on our goals is a key factor in determining what we want to achieve in life. Our physical needs, emotions, and desires all play a role in determining the goals that are important to us. The goal that receives the most votes is the one we will work towards.

Numerical Representation of Human Needs, Desires, and Emotions (NRHDNE)

Understanding human needs, desires, and emotions is a complex task in the field of psychology. However, researchers have found a new way to simplify this process by assigning numerical values to represent these psychological factors.

There are various methods for measuring emotions, including direct measurement, indirect measurement, and dynamic measurement. Emotions can be stored as numerical values and processed through a sigmoid function with hysteresis, with values ranging from -128 to +127 because emotions are typically bipolar.

This approach has already been tested in a research study where researchers used the model to track the levels of motivation, stress, and engagement of animals in a simulated world. The results showed that the animals’ levels of motivation, stress, and engagement could all be accurately represented as numerical values.

The NRHDNE has numerous potential applications in the real world, such as creating proactive agents and robots, and gaining a deeper understanding of human behavior. This new approach to understanding human behavior has the potential to revolutionize our understanding of the psychological foundations of behavior and provide new ways of predicting and influencing behavior in the future.

The numerical representation of human needs, desires, and emotions is a groundbreaking way of understanding human behavior. By simplifying complex psychological issues into simple numerical values, researchers are able to gain new insights and better understand human behavior.

Utilizing AI and ML to Achieve Desired Outcomes: A Guide to Emotion-Driven Goal Setting and Decision Making

In our previous article, “the Theory of Mind AI: Emotion Recognition”, we covered the recognition of emotions.

Today, we are focusing on creating actions and behaviors based on emotions.

Creating goals and taking action based on the estimated value of emotions can be a powerful tool for achieving desired outcomes. By utilizing a Large Language Model (LLM) like GPT-3, combined with other ML techniques, an AI agent can gain valuable insights into the current emotional state of the mind and use that information to guide decision-making process.

The first step in this process can be to use an appropriate prompt to generate a list of potential goals and actions based on the current emotional state. For example, if Agent is feeling stressed and overwhelmed, Agent might use a prompt like “What are some potential goals and actions Agent can take to reduce {stress} and improve {emotional well-being}?”. The knowledge base can be derived from two sources, firstly, the training and fine-tuning of the model and secondly, from the experiences of the AI Agent.

Once Agent has a list of potential goals and actions, the next step is to use the model again with a suitable prompt to evaluate the impact of each action on motivational parameters. For example, AI agent might use a prompt like “What is the impact of the {action} on {motivational parameter}?”

By sorting and returning the action with the optimal impact on motivational parameters, AI agent can make a final decision on which action to take. This process can be repeated as needed until desired outcome is achieved.

The use of a LLM like GPT-3 in this way can be an effective way to gain insight into emotional state, set goals and take action towards achieving them. By utilizing the estimated value of emotions, AI agent can make more informed and effective decisions for achieving desired outcomes.

The Advancements in Emotion Recognition and Adaptive Behaviour

As technology continues to advance, the way we interact with machines is changing as well. One of the latest technological breakthroughs is emotion recognition, which uses artificial intelligence and machine learning algorithms to detect and comprehend human emotions.

Personalized and User-Friendly Experiences

The potential for revolutionizing our interaction with machines through emotion recognition is immense, leading to the development of more personalized and user-friendly experiences. With the integration of emotion recognition, machines will be able to adjust their behavior based on a person’s emotional state.

Adaptive Behaviour

For example, if a person is feeling sad, a machine may respond with a comforting message or change its interface to a more cheerful design. If a person is feeling frustrated, the machine may adjust its responses to provide more helpful and concise information. This technology has the potential to greatly enhance the user experience by allowing machines to understand and respond to our emotions in a more intuitive and human-like manner.

Limitless Potential

The future of emotion recognition and adaptive behavior is incredibly promising and holds limitless potential. It opens up new avenues for personalization and customization, allowing machines and humans to interact in a more natural and intuitive way.

Conclusion

The future of emotion recognition and adaptive behavior is one of the most exciting areas of technological advancement. With its integration, we will see a world where machines are able to understand and respond to our emotions, leading to a more personalized and user-friendly experience for all.

The theory of mind AI is expected to be particularly useful in several fields, such as:

  1. Robotics and automation — AI systems with a theory of mind can better understand and respond to human behavior and emotions.
  2. Healthcare — AI systems with a theory of mind can be trained to diagnose and treat mental health issues more effectively.
  3. Marketing and advertising — AI systems with a theory of mind can predict consumer behavior based on emotions and personal preferences.
  4. Education — AI systems with a theory of mind can personalize learning experiences for students based on their emotions and learning styles.
  5. Customer service — AI systems with a theory of mind can better understand and respond to customer emotions and needs, leading to improved customer satisfaction.

Overall, the theory of mind is expected to be useful in fields where AI interacts with humans and requires a deeper understanding of human behavior, emotions, and motivations.

In my upcoming article, we will delve into the transformative power of empathy. We will examine how an AI agent can alter an individual’s emotions and motivations, processing them as if they were its own.

--

--