16 KiB
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Identifier Lead Triage with ECHOBASE
[REDACTED]
JUN 2012
NSA - S2I51 NSA - T1442
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
The Problem
SIGINT is very good at 2 things:
- Establishing lists of potential leads (50-10k+)
- Manual analysis to vet individual targets
Potential leads 50-10k+ ???? Manual analysis
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 2
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Tradecraft
A common model for identifier lead lists, today:
Input
- Seed List Provided to SIGDEV
Phase 2
- Normalize and Expand Selectors
Phase 3
- Foreignness and Compliance Check
Phase 4
- SIGINT Queries on Selector activity and behavior attributes
Bulk enrichment of 'SIGINT business knowledge'
????
Manual analysis
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 3
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Triage Today
After initial enrichment checks, the analyst is often left with too many identifiers of "possible interest"
No Further Analysis Needed 20%
Definite Interest (Pri 1) 5%
Possible Interest (Pri 2) 75%
Percentages are conceptual
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 4
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Bulk Lead Triage via Behavior Analytics
- Hundreds or thousands of selectors to go through high level vetting very quickly
- Better triage prioritization allows for highly adjustable thresholds to be set for follow -on analysis
- Compliance can be inserted at both the “batch result” and “query” level
- Potentially utilize multiple clouds & cross-enterprise analytics
No Further Analysis Needed 20%
Definite Interest (Pri. 1) 5%
High Interest (Pri 2) 15%
Low Interest (Pri 4) 25%
Medium Interest (Pri 3) 35%
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 5
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Identifier 'SIGINT Business' Enrichment
Bulk gathering, via Identifier Scoreboard (phase 2/phase 3)
- Targeting
- Authorities
- Reporting
- Targets
- Knowledge
- Foreignness
- Compliance
...not a raw SIGINT query
Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY
About | Contact | A little help?
Airport Threat
IDENTIFIER
SCOREBOARD
Hide lineup
Add identifiers
Validate >>
Change realm | Delete
Added | Context | Realm
[REDACTED] | 12147 | [REDACTED] X
[REDACTED] | [REDACTED] | yahoo X
[REDACTED]<skypeUser> | [REDACTED] | skypeUser X
Import identifiers
Targeting tag
flag
Targeting category
Targeting zipcode
Query/criteria list
[REDACTED] X
Priority Email X
Choose...
Target
[REDACTED] X
Choose...
Choose...
Retrieve up-to-date FOREMAN data
Include correlations
Clear Save Search
---
SIGINT
ANALYTICS
Identifier view
Target view
Create target | Customize | Send to...
Targeting | Foreignness | Knowledge
| Normalized identifier | Comms | PSC | Tip | TAO | CNE | POCS | CONTRAOCTAVE | FOREMAN | Comments | Location | Reports | Actions |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| [REDACTED] | 1 | n/a | unknown | |||||||||
| [REDACTED] | 1 | n/a | unknown | 10 | ||||||||
| [REDACTED] | [REDACTED] (S2112) | n/a | unknown | [REDACTED] | ||||||||
| [REDACTED] | [REDACTED] (F52) | n/a | unknown | [REDACTED] | ||||||||
| [REDACTED] | 4 | n/a | unknown | 3 |
Last updated: 2012-Mar-01 09:58:46 Z
Displaying 1-100 of 154 page 1 of 2
Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 6
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
'Yes/No' Identifier Behavior
Bulk triage, via SIGINT Analytics Mode (start of phase 4)
Core set of 'yes/no' behavioral questions about a set of identifier leads
...against raw SIGINT!
Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY
About | Contact | A little help?
SIGINT
Airport Threat
Scoreboard
Has this identifier been in direct communications with a targeted identifier?
Identifiers supported: DNI and DNR
Legal authorities: EO12333_S, EO12333_X, FAA_702_CP, FAA_
702_CT, FAA 02_FG, FAA 704/705B
Results updated: Daily
more...
Identifier view
Target view
Customize | Send to...
| Normalized identifier | Positive Results | Direct Comms with Target? | Targeted Contact? | In Captured Media? | [REDACTED] | Seen | Actions |
|---|---|---|---|---|---|---|---|
| [REDACTED] | 2 | * | n/a | n/a | n/a | ||
| [REDACTED] | n/a | ||||||
| [REDACTED]View detailed analytic results | 4 | Targets: [REDACTED] TP [REDACTED] TP First heard: 25 Oct 2011 Last Heard: 09 Mar 2012 |
[REDACTED]First heard: 03 Dec 2011 Last heard: 29 Feb 2012 |
[REDACTED] | |||
| [REDACTED] | 3 | * | |||||
| [REDACTED] | n/a | ||||||
| [REDACTED] | 4 | * | * | * | |||
| [REDACTED]<facebookname | 2 | * | |||||
| [REDACTED] | 0 | ||||||
| [REDACTED] | 0 | ||||||
| [REDACTED] | 2 | * | |||||
| [REDACTED] | 2 | * | |||||
| [REDACTED] | 0 | ||||||
| [REDACTED] | 0 | ||||||
| [REDACTED] | 0 | n/a | n/a | n/a | |||
| [REDACTED] | 2 | * | |||||
| [REDACTED] | 4 | * | * | * | |||
| [REDACTED] | 2 | * | n/a | n/a | n/a |
Last ran on: 2012-Mar-01 09:58:46 Z
Displaying 1-100 of 148 page 1 of 2
(U//FOUO) Page Publisher: Identifier Scoreboard, T1422 | Content [REDACTED] T14 | Last Reviewed: 15-Dec-2010 | Last Modified: 23-Feb-2012
(U//FOUO) Derived From: NSA/CSSM 1-52 | Declassify On: 20320108 | Dated: 08 January 2007
Dynamic Page Highest Possible Classification is TOP SECRET//SI//REL TO USA, FVEY
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 7
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
SIGINT Analytics Mode
Triage by aggregate behaviors
| Normalized identifier | Positive Results | Direct Comms with Target? | Targeted Contact? | In Captured Media? | [REDACTED] | Se |
|---|---|---|---|---|---|---|
| [REDACTED] | 2 | * | n/a | n/a | n/a | |
| [REDACTED] | n/a | |||||
| [REDACTED]View detailed analytic results | 4 | Targets: [REDACTED] TP [REDACTED] TP First heard: 25 Oct 2011 Last Heard: 09 Mar 2012 |
[REDACTED]First heard: 03 Dec 2011 Last heard: 29 Feb 2012 |
[REDACTED] | ||
| [REDACTED] | 3 | * | ||||
| [REDACTED] | n/a | |||||
| [REDACTED] | 4 | * | * | * | ||
| [REDACTED] | 2 | * | ||||
| [REDACTED] | 0 | |||||
| [REDACTED] | 0 | |||||
| [REDACTED] | 2 | * | ||||
| [REDACTED] | 2 | * |
One column per 'yes/no' question
Quickly zero in on worthy leads
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 8
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
SIGINT Analytics Mode - Detailed View
Dynamic Page - Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY
About | Contact | A little help?
SIGINT
ANALYTICS
Analytic Results: [REDACTED]<msnpassport> 2012-Mar-01 09:58:46 Z
[REDACTED] View in Target Profiler
Had direct communications with a targeted identifier?
[REDACTED]
Seen in captured media? (no results)
Seen in CNE? (no results)
Seen in France?
Seen on a targeted identifier's contact lists, or has a targeted contact? (no results)
[REDACTED]
Had direct communications with a targeted identifier?
First heard: 2012-Mar-01 08:58:42 Z Last heard: 2012-Mar-05 07:55:40 Z
| Date | Description | Source |
|---|---|---|
| 2012-Mar-05 07:55:40 Z | [REDACTED] cc'd email to [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: DS-200A/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-04 09:58:46 Z | [REDACTED] was bcc'd on email from [REDACTED] [REDACTED] |
UUID: [REDACTED] SIGAD/PDDG: DS-200A/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-02 10:56:43 Z | [REDACTED] received email from [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: DS-200B/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-01 08:58:42 Z | [REDACTED] sent email to [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: US-3171/T8 Case notation: [REDACTED] Legal authority category: EO12333 |
Back to top
(U//FOUO) Page Publisher: Identifier Scoreboard, T1422 | Content [REDACTED] T14 | Last Reviewed: 15-Dec-2010 | Last Modified: 23-Feb-2012
(U//FOUO) Derived From: NSA/CSSM 1-52 | Declassify On: 20320108 | Dated: 08 January 2007
Dynamic Page Highest Possible Classification is TOP SECRET//SI//REL TO USA, FVEY
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 9
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
SIGINT Analytics Mode - Detailed View
Had direct communications with a targeted identifier?
First heard: 2012-Mar-01 08:58:42 Z Last heard: 2012-Mar-05 07:55:40 Z
| Date | Description | Source |
|---|---|---|
| 2012-Mar-05 07:55:40 Z | [REDACTED] cc'd email to [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: DS-200A/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-04 09:58:46 Z | [REDACTED] was bcc'd on email from [REDACTED] [REDACTED] |
UUID: [REDACTED] SIGAD/PDDG: DS-200A/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-02 10:56:43 Z | [REDACTED] received email from [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: DS-200B/C4 Case notation: [REDACTED] Legal authority category: EO12333 |
| 2012-Mar-01 08:58:42 Z | [REDACTED] sent email to [REDACTED] | UUID: [REDACTED] SIGAD/PDDG: US-3171/T8 Case notation: [REDACTED] Legal authority category: EO12333 |
Back to top
Go view target knowledge
Go view content
Add new knowledge
External links to guide next steps in analysis
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 10
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
ECHOBASE Analytics Architecture
Initial set of analytic questions
-
Most running within GHOSTMACHINE framework
- Limited contributors
-
GHOSTMACHINE Analytic Engine provides
- QFD hosting of analytic results
- RESTful query interface
Future analytics
- multiple organizations/frameworks
Daily Feeds
Targeting
- OCTAVE
- UTT
Targeted identifiers
GHOSTMACHINE
Selector List
Seeds
Seeded Analytic Seeded Analytic Analytic Analytic
GM Analytic Engine
QFD QFD QFD QFD QFD QFD
Query QFDs Svc
Bulk feeds of analytics results
T12 CDP
User DN, justification, leads & which QFDs ("domains")
Log queries WAVELEGAL
Check user authorizations
CASport
Check user authorizations
Direct service query
Future analytic service
Future analytic ?
Bulk feed of analytic results
Non-GM Analytic
FGS
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 11
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
2012 Olympics Sharing
GCHQ
Releasable targeted identifiers
Seeded Analytic Seeded Analytic Seeded Analytic Seeded Analytic
Job Tracker
(GCHQ architecture details omitted)
NSA
Lineup query details
User DN, justification, leads & which QFDs ("domains")
Daily Feeds
Targeting
- OCTAVE
- UTT
Targeted identifiers
GHOSTMACHINE
Selector List
Seeds
Seeded Analytic Seeded Analytic Analytic Analytic
GM Analytic Engine
QFD QFD QFD QFD QFD QFD
Query QFDs Svc
Bulk feeds of analytics results
T12 CDP
User DN, justification, leads & which QFDs ("domains")
Log queries WAVELEGAL
Check user authorizations
CASport
Check user authorizations
Bulk feed of analytic results
Non-GM Analytic
FGS
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 12
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
2012 Olympics Support
- NSA SID Leads Evaluation Cell
- Triage of Olympics-based leads through the event
- Leverage both NSA and GCHQ-produced analytics
- Greater SID-wide usage following the Olympic period
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 13
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL
Contact/Information
- Briefers:
- [REDACTED]
- [REDACTED]
- ECHOBASE Alias:
- [REDACTED]
- NSA WikiInfo page:
- [REDACTED]
TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 14