Can you trust AI’s answer to your question? Here’s what to consider

Following recent queries, I typed a straightforward question into Google search: "How much screen time is too much for teenagers?" Surprisingly, instead of traditional links, the search engine provided an AI-generated response. The artificial intelligence cited a specific figure, then expanded on the idea, stating that quality and balance of time might matter more than the number of hours, and that "too much" could depend on factors like sleep, exercise, school demands, and mood.

Another search I conducted was: "Should I take a daily aspirin?" This time, the AI provided medical information, cautioned about potential risks, and even offered tailored guidance if I supplied my age and medical history. These replies were valuable. However, what intrigued me was that they were of different kinds. The debate around AI answers has largely centered on accuracy: Did the system provide the correct answer?

While accuracy is important, it is only one aspect to consider. Each kind of AI response demands a different evaluation from the user. I found it helpful to categorize AI answers into four broad types: factual, interpretive, constructive, and strategic.

A factual claim is often verifiable against a source. An interpretation can be accurate yet emphasize certain evidence over others. A construction may be logically sound yet irrelevant to the individual receiving it. An expertly written strategic document may still be inaccurate. Despite AI delivering all four types of answers in a similar, authoritative manner, the distinctions are often overlooked.

I, as a university librarian and dean of libraries at the University of Virginia, have been involved in developing AI competencies for library professionals and have consulted extensively on AI literacy. I initially proposed this categorization in The Journal of Academic Librarianship. These four categories are not rigid boxes. An AI response might encompass multiple types.

I will describe each type of answer below and provide guidance on determining whether a reply is appropriate or requires further investigation. How do you discern which kind of answer Google is providing you?