Back to the Index

Theory-of-Mind Tasks

What is Theory of mind (ToM)?

Theory of mind (ToM) is considered the ability to impute unobservable mental states in other sentient beings (or agents). Theory-of-mind (ToM) tasks require understanding an agents' beliefs, goals, and mental states. ToM tasks are considered the goal standard for evaluating common-sense reasoning involving humans. Some researchers have speculated that recent LLMs, such as GPT-4, may have reached significant levels of ability to solve ToM tasks. Kosinski showed that the LLM GPT-4 could solve 95% of a set of  40 classic false-belief tasks widely used to test ToM in humans.This compared to GPT-3 that could only solve 40% of false-belief tasks-performance - comparable with 3.5-year-old children.

Kosinski showed the importance of crafting good prompts - “appropriate prompting enhances LLM ToM reasoning, and they underscore the context-dependent nature of LLM cognitive capacities”.

Does this content look outdated? If you are interested in helping us maintain this, feel free to contact us.

© Hopsworks 2023. All rights reserved. Various trademarks held by their respective owners.

Privacy Policy
Cookie Policy
Terms and Conditions