Unearthing CREST: CIA's Declassified Archives
If you enjoy Best’s work unearthing CIA and FBI history, please consider a one-time or recurring donation.
Backed by Michael Morisy, William Green, David Giglio, Nathan Lawrence, and 11 others.
- Michael Morisy
- William Green
- David Giglio
- Nathan Lawrence
- Jack McCaslin
- Dan Nemec
- Elizabeth Stewart
- Matthew Hoppock
- 7 anonymous backers
$1,155.00 raised out of $1,150.00.
World Tour Guides
Image via CIA’s Flickr
Uploading large sets (hundreds, thousands, or even millions) of documents to DocumentCloud using the user interface can be laborious and requires careful monitoring of uploads for processing errors and splitting up the document set into smaller batches.
DocumentCloud’s Batch Upload Script was initially written to upload the CIA Crest files, which contains almost 1 million files. It keeps track of which files were uploaded successfully, so that it can be stopped and restarted and it will pick up where it left off, and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing CTRL+C (once) while it is running. A recent rewrite allows the script to run on any directory of documents.
What we talk about when we talk about █████: Secrecy, overclassification, and the CIA’s hidden history
In 1978, the director of the CIA warned that excessive, impulsive secrecy was a danger — not only to the public’s right to know, but to the agency’s ability to keep the important secrets. 40 years later, that lesson still needs repeating.
Heading to New Orleans for #ONA2019 and not sure what to wear in Louisiana in the fall? Well, you’re in luck. The Society of Former Special Agents of the Federal Bureau of Investigation had their annual conference in NOLA in 1972, and their official publication, “The Grapevine,” has you covered. Literally.