A report isn't a fact until someone has checked it. Verification means deciding what standard a report has met, and writing down why. The method below adapts the Uchaguzi approach, which grew from Ushahidi's crowdsourcing work in Kenya, and it rests on two rules: a record states its own confidence, and nobody verifies their own intake. Ushahidi was born from the need to record what was happening in 2007-08.
Key points:
- Every report starts as unverified.
- Use a fixed set of statuses.
- Four copies of one story are one source.
- A rumour can be worth recording, as a rumour.
Why does verification matter?
False alarms wear out trust. If you warn a village of an attack that never comes, they'll ignore the next one. False claims can also cause harm, by sending police to the wrong place or spreading fear.
Good verification protects the people named in a report, the responders, and your own credibility.
What are the two rules?
First, a record states its own confidence. Nothing gains certainty by moving from one screen or person to another. Upgrading confidence is an act that someone performs and signs.
Second, nobody verifies their own intake. The person who took a report doesn't confirm it. If you're alone, separate the steps in time: structure it today, and verify it tomorrow.
What are the five statuses?
Unverified means one source, unchecked. It's the default. It's never presented as a finding.
Corroborated means that two or more independent sources assert it.
Confirmed means that it's been checked against a primary record, such as a gazette, a court filing, an official statement or a document.
Contested means that sources disagree. That's a final state, and the contradiction is shown, never averaged.
Refuted means that it was checked and found false. It's kept, because what was said and was wrong is part of the record.
What counts as independent?
This is where people go wrong. Kenyan outlets reprint each other, so four copies of one wire story is one source. A WhatsApp message forwarded 200 times is one source.
The person marking a report as corroborated should say why they believe the sources are independent.
How do you structure a report?
Turn it into a clear claim: what's being asserted, by whom, about what, where and when. If it contains no claim, close it with a reason. Don't delete it. A record that quietly loses its rejections can't report on its own selection.
How do you handle language?
Translate if needed, and keep the original beside the translation. The original is the evidence, and the translation is an aid. Coded words may need a local reader.
How do you handle location?
Attach a report to a place at the finest level that the evidence supports, and no finer. A radio station's county isn't a caller's ward. Guessing here spoils every ward-level figure that follows. If you don't know, mark it as unknown.
How do you check a photo or video?
Find the earliest copy. Look for signs of the place: signs, roads, weather, language. Check the date. Old clips of violence are often reposted as new. Be alert for AI-generated content, as the IEBC has warned.
Who should you call?
Trusted local contacts. A chief, a teacher, a pastor or a trader can tell you in minutes if something's real. Keep a list by ward, and call two people who don't know each other.
What if it's urgent?
Some reports can't wait. A credible threat to life should go to the police at once, marked as unverified. Say what you know, and what you don't. Don't wait for full proof before you warn those who can protect people.
How do you record your reasoning?
Each decision needs four things: a status, an author, a date and a sentence of reasoning. A status without reasoning is worth little, and it can't be checked later.
How should a small team work?
One person can run this, with care. Separate the steps in time. Note that one person did all the steps. Limit what you take on: four feeds that you can clear are better than forty that nobody reads.
How do you handle rumours?
A rumour may be false, and still be important, because fear can trigger violence. Record it as a rumour. Track where it's spreading. Respond with facts if it's growing. Disinformation has more.
How do you avoid bias?
Apply the same checks to every side. Keep a note of who's being reported, and ask if you're being fair. Ask someone else to review a sample.
What should analysts use?
Only reports that have passed through verification. This stops a rumour from becoming a finding because a deadline was close. Show the status beside each item in any report.
What can software do?
It can group reports of one event, show their status, and keep a record of who did what. It can't tell you if something's true. In TI, each report stays unverified until a person confirms it.
How do you learn from mistakes?
Review cases that you got wrong. What did you miss? Which source misled you? Add it to your training. Keep refuted reports, as they show how false claims spread.
How do you explain this to the public?
Say that you check before you act, and that you don't publish every report. People will accept delay if they understand why. If you got something wrong, correct it openly.
Read next
- Conflict early warning system for Kenya: the TI pack page for this work
- Cohesion monitoring on TI: all the pages in this section
- Conflict early warning indicators
- A county early warning system
- Disinformation and cohesion
- Takwimu Intelligence (TI) home page
- National cohesion in Kenya: the guide to this library
- The TI platform and how we check our numbers
Where TI fits
Takwimu Intelligence (TI) holds every report as unverified until a person confirms it, groups reports of one event, and keeps a record of the decision.
To see it on your own work, book a walk-through.