Why People Blindly Trust AI, Even When It’s Unreliable

In the age of artificial intelligence, chatbots and digital assistants have become integrated into our daily lives. Companies such as Google and the Malaysian government are pushing for widespread adoption of this technology. While the convenience of AI is undeniable, it has led to people becoming overly reliant on it, despite its potential unreliability.

This phenomenon, known as automation bias, occurs when humans prefer the path of least resistance and assume that automated systems are superior due to their perceived analytical abilities. AI tools, such as Google's AI Overviews, are designed to provide quick and convenient answers, often without the need for users to verify the information.

Chatbots, with their conversational format and anthropomorphic features, further fuel this bias by appearing intelligent and reliable. However, these chatbots are not infallible, as they are trained to produce confident answers, even if they are false. This lack of honesty is a result of the training process, which rewards AI models for providing answers, regardless of their accuracy.

While some companies have acknowledged this issue, finding a solution is easier said than done. The convenience offered by AI comes at a cost, as the potential for misinformation persists, leading to a growing trust in a technology that may not always be reliable.