Skip to Main Content
Pollak Library

Artificial Intelligence (AI)

Evaluating AI Sources

Image of magnifying glass evaluating factsAlways Evaluate Your Sources

Just like other sources used for research and writing, you need to evaluate and fact-check the information produced by generative AI tools for accuracy and bias. If you are using AI-generated content in your assignments* you will be the one held responsible if it contains inaccurate, biased, or outright bigoted information. 

The resources on this page can provide you with the skills and resources needed to evaluate the information produced by AI so that you can feel confident using it for your research and writing. 

Reminder: Each professor may have different policies on the use of AI in their class and assignments. Always consult your professor, course syllabus, or assignment instructions before using AI-generated content in your assignment.

Lateral Reading for AI Fact Checking

What is it?

Lateral reading is an essential skill for evaluating information generated by generative AI tools, as it helps to verify the validity of the content. Instead of just reading a response provided by an AI and accepting it as fact (vertical reading), lateral reading involves opening new browser tabs and searching for other sources to corroborate or debunk the information

When you use lateral reading to evaluate AI-generated content, you are essentially fact-checking the AI's output. This is crucial because generative AI can produce content that sounds confident and authoritative but may contain hallucinations, misinformation, or biases. Hallucinations are fabrications that an AI presents as factual information. For example, an AI might cite a nonexistent study or a quote from a person who never said it.

Here's how lateral reading helps

  • Corroboration: By searching for the same information from multiple, reliable sources, you can see if the facts presented by the AI are widely accepted. If other credible sources report the same information, it increases your confidence in the AI's response. Conversely, if no other sources mention the information, it's a major red flag.
  • Source Verification: A key part of lateral reading is investigating the source itself. While an AI may not have a "source" in the traditional sense, it may reference a particular study, publication, or person. You can use lateral reading to search for information about that source's credibility, potential biases, and reputation.
  • Bias Detection: Generative AI models are trained on massive datasets from the internet, which can contain human biases and opinions. Lateral reading allows you to compare the AI's response to a variety of perspectives. If you find that the AI's answer aligns with only one side of a polarized issue, it can alert you to potential bias in its output.

By training yourself to "read laterally," you treat the AI's response as a starting point for your own research rather than the final word. This process helps you identify inaccuracies and ensures that the information you're using is reliable and well-supported.

Learn More:

The videos linked below describe the steps you can take to use lateral reading to assess AI outputs. These outputs include things like basic facts and links to outside websites, and also scholarly information and citations. 

Thinking Critically

Fact-checking is just the start!

Evaluating the outputs of generative AI goes beyond fact-checking. Whether the claims made by AI tools are accurate is only one part of the evaluation process; it is also important to understand how bias can impact the information generated by AI.

Since AI is trained on information created by humans, it often replicates the viewpoints, biases, and outright bigotry that can be found in the training data. When asking questions that don't have a correct or objective answer, the AI tool must choose which viewpoint it will represent in its response. This can mean that the AI tool is relying on existing biases against particularly races, genders, or ethnicities when creating a response. 

Evaluating for Bias

In addition to analyzing the accuracy of AI-generated content, you must also evaluate response’s perspective:

  1. We can start with fractionation- we’re thinking about what claims and perspectives are being represented in the AI response.
    • Brainstorm the groups who might be invested in this issue and who might have a discrete perspective (stakeholders, corporations, governments, demographic groups, nationalities, regions, etc.)
    • Think about the argument as a whole. What perspective(s) can you find here? Which might be missing?
    • Now break down the response into individual claims. What perspective(s) can you find in these claims? Which might be missing?
  2. Time to start your lateral reading. Think about what sources might provide the perspectives above, both the ones in the AI’s response and the ones missing from it.
    • Try publications like newspapers or well-established magazines, like the Atlantic or Scientific American.
    • You can find perspectives you’re looking for in news articles, opinion pieces, speeches, etc. Remember to think critically about these perspectives – some may be based on incorrect facts or a distortion of the issue.
    • Check Wikipedia to get a sense of each publication’s reputation.
  3. Next, think deeper about what assumptions are being made here.
    • What did your prompt assume?
    • What did the AI assume?
    • Who would know things about this topic? Would they have a different perspective than what the AI is offering? Where could you check to find out?
  4. Finally, make a judgment call. What here is true, what is misleading, and what is factually incorrect? Can you re-prompt the AI to try to get a different perspective? Can you dive deeper into one of the sources you found while fact-checking? 

Again, the key is remembering that the AI is not delivering you the one definitive answer to your question. 

Content adapted from the University of Maryland's "Artificial Intelligence (AI) and Information Literacy" guide

AI Detection Tools

Although no tool will give you perfect results, the ones below can help you determine if an image was created by AI or not.