How each result is reached
This page explains how each result on Memory Hole is reached, so you can judge how far to rely on it. Each topic is split into separate claims, each claim is checked against government and court documents, and the documents kept on this site are saved with a hash that shows whether they have changed.
Each topic gets its claims and their results, the documents behind them, where each document came from and a dated log of every addition and correction. Its headline question is left open.
What a result means
Each claim gets one of five fixed sentences about the record. The sentence covers that claim only. Under it the page lists the documents it rests on and any document still needed.
| Result | Meaning | An example |
|---|---|---|
| The record shows this. | A document says this, and the result names the document and the page. | Gladio existed. Gladio |
| Reported here as refuted by a named kind of source. | A primary record, such as a court ruling, a law or the agency's own file, directly contradicts the claim. The result names the kind of source. | No victim of MKUltra was ever formally compensated by the government. MKUltra |
| No record of this yet. | The documents searched are the ones that would hold a record of this, and none does. This describes what was searched. It does not say the claim is false. | The programme ran into the 1970s. ARTICHOKE and BLUEBIRD |
| The public record cannot settle this. | No public record could answer this question, for example a question about causes or the future. | No document ever used the name Monarch. Monarch |
| A document that could test this is not read yet. | A specific document that could test the claim exists and has not been read yet. The result names it. | Ted Kaczynski was an MKUltra subject: Henry Murray's Harvard study of undergraduates was a CIA-linked experiment that shaped the Unabomber. MKUltra |
See a result and its document
The record shows this.
Claim: Gladio existed.
European Parliament resolution on the Gladio affair, Nov. 22, 1990 · Gladio
How a document is checked
Every document the site keeps is saved with a hash: a 64-character code computed from every byte of the file. If one byte changes, the code changes. On each document's page, the Check this copy button recomputes the code in your browser and compares it with the one we published, so you can confirm the copy has not changed since then. The site recomputes every hash each time it is rebuilt and publishes nothing if one differs.
A matching hash shows a file has not changed, and the origin label says where it came from. Neither shows that a claim in the file is true.
How the MKUltra investigation was done
- Questions are fixed before the search. Each question, and what would count against it, is written down, dated and hashed before any document is read. A question added later carries its own date.
- Every search is logged. Searches follow a plan written in advance across reporting, books, official records and court records, and the ones that found nothing are logged too. Each document is fetched, checked to be what it claims to be and saved with its hash, and a page that would not load is recorded as a gap.
- Every fact points to a page. Every fact on these pages points to a quoted line on a numbered page you can open. A script confirms that the quotation is on that page, and a fact whose quotation is not found is left out.
- The timeline is built from those facts. Where two documents give different dates for one event, the line is dated by the document it cites and notes the other date.
- Claims people make are checked against documents. They are recorded in the words people use, so you can find the version you heard. Each is checked against official and court documents. News reports and books show where a claim spread, and no result rests on them.
- Who did what is stated only where a document says so. Each link between two people, whether a post held, a line of command, a payment or a line of training, rests on a checked quotation. A payment shows that money moved, and it does not show that the person paid knew where the money came from.
- Court rulings, payments and rules are read from their own text. Each outcome is taken from the text of the ruling, the law or the order itself, so you can read it in its own words.
- A second reader checks each result. A second reader, who did not gather the fact, reads each result against the cited page. Each page says whether that check is done, and the timeline and the one-line subproject summaries are published before it.
- A search that finds nothing says so. When a search finds nothing, the result says there is no record yet, names the collections searched and names the document that could still change it.
When results are published and changed
- A result names the documents it rests on. Where a document is not kept on this site yet, the result says so beside it.
- Each topic lists the documents still sought.
- Changes stay visible. A new result, or a new line on what a document shows, goes into the topic's history with its date.
Checks the site runs before it publishes
The site will not publish a page that fails any of these checks.
- A document is used by one topic only, so the same document is never counted as support in two places.
- A claim cannot be published without its result.
- A records request that has been sent is never shown as support for a claim.
How sources are rated
No source is rated yet. When ratings are published, each source will carry a letter for its record of reliability and a number for how far other documents support the point it makes. A rating describes one source on one point and says nothing about whether the claim is true.
| Source | Reliability |
|---|---|
| A | Completely reliable |
| B | Usually reliable |
| C | Fairly reliable |
| D | Not usually reliable |
| E | Unreliable |
| F | Reliability cannot be judged |
| Information | Credibility |
|---|---|
| 1 | Confirmed by other sources |
| 2 | Probably true |
| 3 | Possibly true |
| 4 | Doubtful |
| 5 | Improbable |
| 6 | Truth cannot be judged |
Read together: Admiralty rating B2 is a usually reliable source giving information that is probably true.
Where a document came from
Each document kept here is labelled by where it came from. The label describes the file and is always shown apart from any result.
| Label | Meaning |
|---|---|
| Downloaded from the publisher | Downloaded from the publisher's own site. |
| The source says where it got it | The source says where it got the file, and we have not confirmed it. |
| Origin unknown | Where the file came from is not known. |
| Leaked and disputed | The file was leaked, and its authenticity is disputed. |
Memory Hole is published by Hesitation Media in Pittsburgh. The method, called Trustless, is written down so that another newsroom can run it on its own topics. The term slow journalism is Susan Greenberg's, from a 2007 essay in Prospect. Updated . Have a document to send? Contribute. The site-wide reporting standards are on the methodology page.