Not a member? Sign up

AP's Overview tool helps DocumentCloud makes sense of text documents

by: Amy Gahran |

When you're tracking a story that involves reading a huge volume of text documents, it's a challenge to both manage and process the documents and see the big picture. Here's how two pieces of software can help.

A recent Knight Blog post explained how Associated Press reporter Jack Gillum used Document Cloud and Overview to show that showing that former Republican Vice Presidential Candidate Congressman Paul Ryan had requested funds for his district from many federal programs which he criticized on the campaign trail as wasteful.

According to Knight, Gillum relied on two tools to tackle this daunting task:

  • DocumentCloud, to upload scans of documents, perform optical character recognition, and search the contents.
  • Overview, a data visualization tool created by AP that expands the functionality of DocumentCloud to automatically sort documents into topics and visualize the contents.

Overview is designed primarily to process English-language text documents. It's not the tool to use to process tables, data that's primarily numeric, or records exported from a database (unless they include a field containing plain English text).

Both of these tools are available as web applications available for journalists to use free of charge. Both are also previous Knight News Challenge winners. You need a DocumentCloud account to use Overview.

Subscribe to the Newsletter

Amy Gahran

Amy Gahran is a journalist, editor, trainer, entrepreneur, strategist, and media consultant based in Boulder, Colorado. In addition to writing
Read More

Submit an event

Periscope Community Summit

January 14, 2016 - January 17, 2016

Scopers from all over the world will gather at the San Francisco summit to celebrate and share knowledge about community, social and live streaming.

IRE Computer Assisted Reporting, March 10-13

March 10, 2016 - March 13, 2016

Join IRE and NICAR in Denver for the annual conference devoted to data journalism at the Denver Marriott City Center. 

SXSW Interactive Festival, March 11-15

March 11, 2016 - March 14, 2016

The 23rd annual SXSW Interactive Festival returns to Austin from Friday, March 11 through Tuesday, March 15.

Sunshine Week, March 13-19

March 13, 2016 - March 18, 2016

Join us in the annual nationwide celebration of access to public information and what it means for you and your community. Open government is good government.

Submit an event

Is that user submitted photo authentic? Try a new verification tool

By Nancy Yoshihara
11/16/2015 | 10:00 pm GMT

If you’ve received a user-generated photo that looks almost too good to be real, the Verified Pixel Project can help...

The law beyond the First Amendment for media startups

By Nancy Yoshihara
11/9/2015 | 10:00 pm GMT

Any media entrepreneur—for-profit or nonprofit –will find “Law and Media Startups” a useful guide about legal issues involved in operating...