Ulthor Group Intelligence ULTHOR GROUP INTELLIGENCE ALL RESOURCES
Resources — 01

Methodology

How we grade sources, phrase uncertainty, and label the difference between what is verified, what is assessed, and what is merely reported.

This page sets out the standard our published work is held to. It exists so that a reader can tell the difference between something we have confirmed, something we judge to be probable, and something we are merely reporting that others have said.

Source grading

Every source behind a published claim is graded twice and independently: once for the reliability of the source itself, and once for the credibility of the specific piece of information. A source that is usually dependable can still pass on something doubtful, and the two ratings must not be collapsed into one.

Reliability of the source

GradeMeaning
ACompletely reliable. No doubt of authenticity, trustworthiness, or competence; a history of complete reliability.
BUsually reliable. Minor doubt; a history of generally valid information.
CFairly reliable. Doubt exists; has supplied valid information in the past.
DNot usually reliable. Significant doubt; has supplied valid information at times.
EUnreliable. A history of invalid information.
FCannot be judged. No basis on which to assess reliability.

Credibility of the information

GradeMeaning
1Confirmed. Corroborated independently by other sources; logical; consistent with other information on the subject.
2Probably true. Not confirmed, but logical and consistent with other information.
3Possibly true. Reasonably logical; agrees with some other information.
4Doubtful. Not confirmed; possible but not logical; no other information on the subject.
5Improbable. Contradicted by other information; not logical.
6Cannot be judged. No basis on which to assess.

A claim carried as B2 is therefore drawn from a usually reliable source and is probably true but unconfirmed — a very different thing from A1, and it should never be presented to a reader as though it were.

How we phrase probability

Words like "likely" mean different things to different readers, so we fix them to ranges and use them consistently. These terms describe how probable we judge something to be. They are not a statement of how confident we are in the judgement itself, which is a separate axis covered below.

TermApproximate range
Almost certain95–99%
Very likely80–95%
Likely55–80%
Roughly even chance45–55%
Unlikely20–45%
Very unlikely5–20%
Almost no chance1–5%

We avoid hedges that carry no information, such as "it is possible that" or "some reports suggest," where the intended meaning is one of the terms above.

Analytic confidence

Confidence describes the strength of the basis for a judgement, not how likely the judgement is to be true. A high-probability estimate can rest on a weak evidentiary base, and readers are entitled to know when that is the case.

Labels used in our reporting

Our compliance statement commits us to distinguishing verified facts from estimates, allegations, and analytical judgements. In practice that means every substantive claim carries one of four labels.

Verification practice

What we do not do

The limits below are binding regardless of what a story would gain from crossing them, and are set out in full in our legal and ethical compliance statement.

When we get it wrong

Open-source material can be incomplete, outdated, inaccurate, or deliberately misleading, and no methodology removes that risk entirely. Errors we identify or that are reported to us are corrected on the record rather than quietly amended. Every correction is logged, dated, and described in the corrections log.