Not a member? Sign up

AP's Overview tool helps DocumentCloud makes sense of text documents

by: Amy Gahran |

When you're tracking a story that involves reading a huge volume of text documents, it's a challenge to both manage and process the documents and see the big picture. Here's how two pieces of software can help.

A recent Knight Blog post explained how Associated Press reporter Jack Gillum used Document Cloud and Overview to show that showing that former Republican Vice Presidential Candidate Congressman Paul Ryan had requested funds for his district from many federal programs which he criticized on the campaign trail as wasteful.

According to Knight, Gillum relied on two tools to tackle this daunting task:

  • DocumentCloud, to upload scans of documents, perform optical character recognition, and search the contents.
  • Overview, a data visualization tool created by AP that expands the functionality of DocumentCloud to automatically sort documents into topics and visualize the contents.

Overview is designed primarily to process English-language text documents. It's not the tool to use to process tables, data that's primarily numeric, or records exported from a database (unless they include a field containing plain English text).

Both of these tools are available as web applications available for journalists to use free of charge. Both are also previous Knight News Challenge winners. You need a DocumentCloud account to use Overview.

Subscribe to the Newsletter

Amy Gahran

Amy Gahran is a journalist, editor, trainer, entrepreneur, strategist, and media consultant based in Boulder, Colorado. In addition to writing
Read More

Events
Submit an event

Code/Media 2016 meets in California

February 17, 2016 - February 18, 2016

Code/Media will bring together the most influential minds in media and technology for two days of intimate gatherings and game-changing discussions in Laguna, Niguel, CA. Produced by senior editor Peter Kafka, in conjunction with Kara Swisher and Walt Mossberg, this exclusive conference will get you up close and personal with media heavyweights and the tech innovators who want to get into the ring with them.

IRE Computer Assisted Reporting, March 10-13

March 10, 2016 - March 13, 2016

Join IRE and NICAR in Denver for the annual conference devoted to data journalism at the Denver Marriott City Center. 

SXSW Interactive Festival, March 11-15

March 11, 2016 - March 14, 2016

The 23rd annual SXSW Interactive Festival returns to Austin from Friday, March 11 through Tuesday, March 15.

Sunshine Week, March 13-19

March 13, 2016 - March 18, 2016

Join us in the annual nationwide celebration of access to public information and what it means for you and your community. Open government is good government.

The Collaboration Culture Symposium

March 21, 2016 - March 22, 2016

A new “collaboration culture” is emerging and collaboration is becoming the go-to strategy to make things work in the media industries. Join The Collaboration Culture Symposium at the Donald W.

ONA-Poynter present Leadership Academy for Women in Digital Media

Mon, May 2, 2016 8:00 am

The interactive, five-day program for 28 U.S.-based participants will focus on critical leadership skills specific to digital media for the industry’s next generation of women leaders. The tuituion-free program will be held at Poynter’s campus in St. Petersburg, Florida.


Submit an event

Good, bad or even useful data? Help for sorting it all out

By Nancy Yoshihara
2/8/2016 | 11:11 am GMT

Dataproofer is a new, free tool designed to help journalists verify data.  The desktop app was developed by the news...

Amber is here to help you fight link rot and preserve content

By Nancy Yoshihara
1/30/2016 | 10:00 pm GMT

The new free software tool is designed to help bloggers and website owners prevent broken links by taking a snapshot...