Build trust around use of AI

Editor’s note: Our AI work

This research is the first step in a year’s worth of work we have planned focused on AI disclosures and ethics, funded by a grant from the Patrick J. McGovern Foundation. There is a lot to learn, and future research might point to different solutions. But at Trusting News, we believe in learning in public, and sometimes that means sharing knowledge as it evolves.

To follow our work on this topic, subscribe to our weekly Trust Tips newsletter or fill out this form. This Trust Kit was last updated on Sept. 17, 2024.  

Artificial Intelligence

As journalists incorporate Artificial Intelligence tools into their news processes, they need to be establishing clear internal guidelines and public-facing policies governing those practices. 

A crucial step is to routinely communicate those standards to the public. In research conducted by Trusting News and other research organizations like The Reuters Institute, Poynter and Ipsos, people say they want the use of AI by journalists to be disclosed. 

People do not want journalists passing work or ideas off as their own if AI is used. That can be seen as deceptive and could add to the negative assumptions many people already have about “the media.” Instead, through transparency, you can build understanding not just about how journalism operates but about what AI is and how it can be used.

Based on new and previous research, Trusting News is recommending that journalists:

 

Journalists should disclose their use of AI and find ways to explain why AI was used and how humans fact-checked for accuracy and adhered
to ethical standards.

Goals

This Trust Kit helps you: 

  1. Disclose your use of AI to your audience, and explain how and why you use it.
  2. Learn how your audience feels about journalists using AI and what they expect from you when you do use it.
  3. Understand why educating your audience about AI can help build trust and provide a public service.

 

How to disclose

An overwhelming majority (93.8%) of news consumers surveyed by a recent Trusting News cohort of newsrooms said they want the use of AI to be disclosed.

More than half of the respondents said they want to know both how AI was used in the reporting process and details about the specific tool(s) used. (Learn more about this cohort and what we learned here.)

If you are using AI in your newsroom, it seems clear the audience wants to know about it and wants more details than a vague, “AI was used in this story,” statement. Expand the following boxes for guidance on how to write a disclosure. 

(To stay-up-to-date on this research, fill out this form and subscribe to our weekly Trust Tips newsletter.)

What to include in your disclosure

Research shows people are more likely to trust information when they know how it was created. So, explaining exactly what the AI did, why it was used and how humans were involved helps demystify the use of the technology. Reassuring users that the content still meets ethical and editorial standards, even with AI’s involvement, could also further strengthen trust in the specific content and in the newsroom overall. 

According to the data collected by our recent newsroom cohort, news consumers said the following information would be important to include in a disclosure:   

  • Knowing why journalists decided to use AI in the reporting process (87.2% said this would be important)
  • Understanding how journalists will work to be ethical and accurate with their use of AI (94.2% said this would be important)
  • Knowing a human was involved in the process and reviewed content before it was published (91.5% said this would be very important)

Based on this, Trusting News is recommending that disclosures include the following information:

  • Information about what the AI tool did
  • Explanation about why the journalist used AI, ideally using language that demonstrates how the use of AI benefits the community or improves news coverage
  • Description of how humans were involved in the process (assuming this is true)
  • Explanation about how content is still ethical, accurate and meets the newsrooms editorial standards 

The survey data cited in this Trust Kit was analyzed by researchers at the University of Minnesota.

Examples: Sample disclosures

Building on other trust strategies focused on transparency, specifically what language works best to build trust when explaining reporting goals, mission or process, we recommend that a disclosure about using AI could be written like this:

In this story we used (AI/tool/description of tool) to help us (what AI/the tool did or helped you do). When using (AI/tool) we (fact-checked, had a human check, made sure it met our ethical/accuracy standards). Using this allowed us to (do more of x, go more in depth, provide content on more platforms, etc).

Filling in the blanks using the format above, disclosures could look like this:

  • In this story, we used Artificial Intelligence to transcribe the audio from our interviews with sources. We reviewed all quotes for accuracy by listening to the original audio of the interviews, before including them in the story. Using AI made the reporting process more efficient, giving us more time to fact-check this story for accuracy and fairness.  
  • In this investigative story, we used Artificial Intelligence to assist in the analysis of the public records received from the state. The reporters fact-checked the information used in the story by re-reviewing the public records by hand. Requesting public records to get beyond the “he said she said” is an important part of our reporting process, and AI allowed us to do this more quickly.
  • Based on news articles we previously published, we used Artificial Intelligence to help draft the content of this newsletter. Our editorial team carefully reviewed and edited the AI-generated text to ensure it aligns with our standards for accuracy. Using AI allows us to convert our news coverage into different formats, reaching you where you like to consume information.
  • In this story, our original news coverage was translated into multiple languages with the help of Artificial Intelligence. Our team carefully reviewed and edited the translation to ensure it accurately conveys the intended meaning and maintains the quality of our reporting. Utilizing AI for translation allowed us to quickly share our stories with a broader audience.

How to engage 

By actively involving the audience in discussions about the use of AI in news production, journalists demonstrate a commitment to transparency and inclusivity. This approach allows journalists to understand community concerns, preferences and expectations regarding AI, leading to more tailored and relevant reporting.

Also, soliciting feedback and insights from the community can foster a sense of partnership and co-creation, empowering the community to actively participate in shaping the future of journalism and creating stronger relationships. 

Newsroom case study: ARLnow

One example of a newsroom listening comes from ARLnow. In this example, we see a newsroom change course after hearing feedback from its audience. The newsroom was sometimes using AI to create images when they did not have actual photos to fit with a story.

The newsroom received feedback from their audience expressing discomfort with this practice, so the newsroom decided to ask the audience if they were comfortable with AI being used in their news coverage this way. While a majority said they were, 48% said they were not, so the newsroom said it would stop this practice and instead, commission “human-created illustrations for the real estate and local business stories for which AI images were previously used.” While sharing this news they also shared the 10 ways they are using AI in their news process.

So, how can you listen?

You should base your decisions about how to talk about your AI work on what will be helpful to the specific community you serve. What do they understand? What do they fear? What are they looking for? 

To help newsrooms engage and listen to their audiences about AI, Trusting News has developed two tools:

Survey: “Using Artificial Intelligence in our journalism”

Trusting News created this survey for newsrooms to use, drawing on previous research and journalist feedback about transparency and disclosure. The goal was to better understand news consumers’ comfort levels with how journalists use AI and to gather insights on what should be included in disclosures. The survey aimed to address the current needs of newsrooms by focusing on how AI is being used or how newsrooms are considering using it in reporting rather than exploring its full range of potential uses.

Trusting News is making the full survey available so other newsrooms can replicate it in their own communities. Click here to make a copy of our survey for your own use.

Some of the questions from the survey include:

  • How specific should explanations about our newsroom’s use of AI be?
  • Is knowing why we decided to use AI in our reporting process important to you?
  • Would it be useful if our newsroom provided information and tips to help you better understand AI in general and detect when content has involved the use of AI?

When Trusting News asked newsrooms to use the survey in a recent cohort, most of the newsrooms used the provided Google form to collect data, while a few opted for platforms like SurveyMonkey. To share the survey with their audiences, newsrooms shared the survey link within stories, newsletters and social media. View examples below of how different newsrooms distributed the survey.

AI Community Interview Guide

To gather deeper insights into perceptions of AI use and understanding of the technology, newsrooms can conduct one-on-one interviews with community members. 

Research shows that journalists simply taking the time to talk and listen to people builds trust and goodwill. In one Trusting News listening project, 86% of community members interviewed said they felt a sense of trust building with the reporter or the news organization after a conversation with a journalist about news consumption, and 28% said they were considering subscribing to that news outlet. The journalists said it helped them better understand how to serve their audiences.

Think about the impact this could have if newsrooms incorporated this practice into their larger efforts. That’s true in general, and it’s true for specific topics like the use of AI.

Building on this, Trusting News created an “AI Community Interview Guide” for journalists to use in their own communities. Find the full the guide here

Some of the questions in the guide include:

  • Is there anything you’re afraid of when it comes to us using AI?
  • When we use AI, what do you want to know about that use?
  • When thinking about a new organization’s use of AI, how important is it to you that a human was still involved in the process or looked at the content before it was  published?

        Click or swipe through the below examples of how newsrooms shared this audience survey about AI. 

        How to educate

        Educating the community about AI and technology is one way we believe journalists can build trust with their audience. By demystifying complex technologies and explaining how they’re used in journalism and their community, journalists can foster transparency and understanding. They can also model responsible exploration with tools that can seem intimidating. This education can empower the audience to critically evaluate the role of AI in the world and make decisions about how they use it and want to see it used in their communities.

        Survey data: Audiences want AI education

        News consumers say they want to be educated about AI and its use and would welcome that education from journalists and newsrooms.

        In a recent Trusting News cohort, more than 80% of the survey respondents said it would be helpful if a newsroom provided information and tips to better understand AI in general and detect when AI was used in content creation. The demand for education around AI became even more clear during the one-on-one interviews.

        When asked about education and engagement opportunities around AI, people told the journalists:

        • To offer workshops and create guides/glossaries or articles explaining AI’s role in reporting, as it would help people differentiate between ethical AI use and misuse
        • To offer opportunities for people to learn about AI’s capabilities and limitations, potentially through outreach events or interactive/Q&A sessions
        • To produce more in-depth articles and transparency around AI’s use in journalism
        • They appreciated being consulted and wanted newsrooms to continue engaging the public in conversations about AI

        Some, particularly those who said they were knowledgeable about AI, were less interested in educational opportunities but said they still believed these efforts could benefit the general public and smaller news organizations.

        How journalists can help people understand AI

        Based on the majority of people surveyed saying they want to see journalists provide tips to better understand AI, Trusting News would like to see and help newsrooms explore the following opportunities:

        • Develop educational resources. Creating guides and articles that explain AI technology, how to detect it and more.
        • Host workshops and webinars. Offering sessions where audiences can learn about AI and its role in the information space but also how it can be used in daily life and is being used in other ways throughout the community.
        • Host listening events. Continually asking the community about their thoughts on AI use in news coverage, the concerns they have and suggestions on what they want to see and what they would find helpful.

        If journalists are seen by their community as a trusted and useful source of information and explanations about AI, it can build a stronger bond between journalists and their community, bolstering trust and credibility in the news they deliver. We hope you will explore how to best educate your communities about AI and use resources that are already out there from groups including:

        See examples from other newsrooms

        Click or swipe through the below examples of how newsrooms are responsibly using AI and disclosing their use of AI to their audience. For more newsroom examples, check our our newsroom example database.  

         This Trust Kit was last updated September 17, 2024.