Algorithm aversion - Wikipedia

Jump to content

Search

Search

Donate

Create account

Log in

Personal tools

Donate

Create account

Log in

Algorithm aversion

2 languages

فارسی<br>日本語

Edit links

From Wikipedia, the free encyclopedia

Biased assessment of an algorithm

This article is written like a personal reflection, personal essay, or argumentative essay that states a Wikipedia editor's personal feelings or presents an original argument about a topic. Please help improve it by rewriting it in an encyclopedic style. (October 2023) (Learn how and when to remove this message)

Algorithm aversion is defined as a "biased assessment of an algorithm which manifests in negative behaviors, and attitudes towards the algorithm compared to a human agent."[1] This phenomenon describes the tendency of humans to reject advice or recommendations from an algorithm in situations where they would accept the same advice if it came from a human.

Algorithms, particularly those utilizing machine learning methods or artificial intelligence (AI), play a growing role in decision-making across various fields. Examples include recommender systems in e-commerce for identifying products a customer might like and AI systems in healthcare that assist in diagnoses and treatment decisions. Despite their proven ability to outperform humans in many contexts, algorithmic recommendations are often met with resistance or rejection, which can lead to inefficiencies and suboptimal outcomes.

The study of algorithm aversion is critical as algorithms become increasingly embedded in our daily lives. Factors such as perceived accountability, lack of transparency, and skepticism towards machine judgment contribute to this aversion. Conversely, there are scenarios where individuals are more likely to trust and follow algorithmic advice over human recommendations, a phenomenon referred to as algorithm appreciation.[2] Understanding these dynamics is essential for improving human-algorithm interactions and fostering greater acceptance of AI-driven decision-making.

Examples of algorithm aversion<br>[edit]

Algorithm aversion manifests in various domains where algorithms are employed to assist or replace human decision-making. Below are examples from diverse contexts, highlighting situations where people tend to resist algorithmic advice or decisions:

Healthcare<br>[edit]

Patients often resist AI-based medical diagnostics and treatment recommendations, despite the proven accuracy of such systems. For instance, patients tend to trust human doctors more, as they perceive AI systems as lacking empathy and the ability to handle nuanced emotional interactions. Negative emotions are more likely to arise as AI plays a larger role in healthcare decision-making.[3]

Recruitment and employment<br>[edit]

Algorithmic agents used in recruitment are often perceived as less capable of fulfilling relational roles, such as providing emotional support or career development. While algorithms are trusted for transactional tasks like salary negotiations, human recruiters are favored for relational tasks due to their perceived ability to connect on an emotional level.[4]

Consumer behavior<br>[edit]

Consumers generally react less favorably to decisions made by algorithms compared to those made by humans. For example, when a decision results in a positive outcome, consumers find it harder to internalize the result if it comes from an algorithm. Conversely, negative outcomes tend to elicit similar responses regardless of whether the decision was made by an algorithm or a human.[5]

Marketing and content creation<br>[edit]

In the marketing domain, AI influencers can be as effective as human influencers in promoting products. However, trust levels remain lower for AI-driven recommendations, as consumers often perceive human influencers as more authentic. Similarly, participants tend to favor content explicitly identified as human-generated over AI-generated, even when the quality of AI content matches or surpasses human-created content.[6][7]

Cultural differences<br>[edit]

Cultural norms play a significant role in algorithm aversion. In individualistic cultures, such as in the United States, there is a higher tendency to reject algorithmic recommendations due to an emphasis on autonomy and personalized decision-making. In contrast, collectivist cultures, such as in India, exhibit lower aversion, particularly when familiarity with algorithms is higher or when decisions align with societal norms.[8]

Moral and emotional decisions<br>[edit]

Algorithms are less trusted for tasks involving moral or emotional judgment, such as ethical dilemmas or empathetic decision-making. For example, individuals may reject algorithmic decisions in scenarios where they perceive moral stakes to be high, such as autonomous vehicle decisions or medical life-or-death situations.[9]

Mechanisms underlying algorithm aversion<br>[edit]

Algorithm aversion arises from a combination of psychological, task-related,...