TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL # Identifier Lead Triage with ECHOBASE [REDACTED] JUN 2012 NSA - S2I51 NSA - T1442 TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## The Problem SIGINT is very good at 2 things: 1. Establishing lists of potential leads (50-10k+) 2. Manual analysis to vet individual targets Potential leads 50-10k+ ???? Manual analysis TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 2 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## Tradecraft A common model for identifier lead lists, today: Input * Seed List Provided to SIGDEV Phase 2 * Normalize and Expand Selectors Phase 3 * Foreignness and Compliance Check Phase 4 * SIGINT Queries on Selector activity and behavior attributes Bulk enrichment of 'SIGINT business knowledge' ???? Manual analysis TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 3 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## Triage Today After initial enrichment checks, the analyst is often left with too many identifiers of "possible interest" No Further Analysis Needed 20% Definite Interest (Pri 1) 5% Possible Interest (Pri 2) 75% Percentages are conceptual TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 4 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## Bulk Lead Triage via Behavior Analytics * Hundreds or thousands of selectors to go through high level vetting very quickly * Better triage prioritization allows for highly adjustable thresholds to be set for follow -on analysis * Compliance can be inserted at both the “batch result” and “query” level * Potentially utilize multiple clouds & cross-enterprise analytics No Further Analysis Needed 20% Definite Interest (Pri. 1) 5% High Interest (Pri 2) 15% Low Interest (Pri 4) 25% Medium Interest (Pri 3) 35% TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 5 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## Identifier 'SIGINT Business' Enrichment Bulk gathering, via Identifier Scoreboard (phase 2/phase 3) * Targeting * Authorities * Reporting * Targets * Knowledge * Foreignness * Compliance ...not a raw SIGINT query ``` Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY About | Contact | A little help? Airport Threat IDENTIFIER SCOREBOARD Hide lineup Add identifiers Validate >> Change realm | Delete Added | Context | Realm [REDACTED] | 12147 | [REDACTED] X [REDACTED] | [REDACTED] | yahoo X [REDACTED] | [REDACTED] | skypeUser X Import identifiers Targeting tag flag Targeting category Targeting zipcode Query/criteria list [REDACTED] X Priority Email X Choose... Target [REDACTED] X Choose... Choose... Retrieve up-to-date FOREMAN data Include correlations Clear Save Search --- SIGINT ANALYTICS Identifier view Target view Create target | Customize | Send to... Targeting | Foreignness | Knowledge ``` | Normalized identifier | Comms | PSC | Tip | TAO | CNE | POCS | CONTRAOCTAVE | FOREMAN | Comments | Location | Reports | Actions | | --------------------- | ----- | --- | --- | --- | --- | ------------------ | ------------ | ------- | -------- | ---------- | ------- | ------- | | [REDACTED] | | | | | | 1 | n/a | unknown | | | | | | [REDACTED] | | | | | | 1 | n/a | unknown | | | 10 | | | [REDACTED] | | | | | | [REDACTED] (S2112) | n/a | unknown | | [REDACTED] | | | | [REDACTED] | | | | | | [REDACTED] (F52) | n/a | unknown | | [REDACTED] | | | | [REDACTED] | | | | | | 4 | n/a | unknown | 3 | | | | ``` Last updated: 2012-Mar-01 09:58:46 Z Displaying 1-100 of 154 page 1 of 2 Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY ``` TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 6 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## 'Yes/No' Identifier Behavior Bulk triage, via SIGINT Analytics Mode (start of phase 4) Core set of 'yes/no' behavioral questions about a set of identifier leads ...against raw SIGINT! ``` Dynamic Page Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY About | Contact | A little help? SIGINT Airport Threat Scoreboard Has this identifier been in direct communications with a targeted identifier? Identifiers supported: DNI and DNR Legal authorities: EO12333_S, EO12333_X, FAA_702_CP, FAA_ 702_CT, FAA 02_FG, FAA 704/705B Results updated: Daily more... Identifier view Target view Customize | Send to... ``` | Normalized identifier | Positive Results | Direct Comms with Target? | Targeted Contact? | In Captured Media? | [REDACTED] | Seen | Actions | |-----------------------|------------------|---------------------------|-------------------|----------------------|------------|------|---------| | [REDACTED] | 2 | * | n/a | n/a | n/a | | | | [REDACTED] | n/a | | | | | | | | [REDACTED]View detailed analytic results | 4 | Targets:
[REDACTED] TP
[REDACTED]

TP First heard: 25 Oct 2011
Last Heard: 09 Mar 2012 | | | [REDACTED]First heard: 03 Dec 2011
Last heard: 29 Feb 2012 | [REDACTED] | | | [REDACTED] | 3 | * | | | | | | | [REDACTED] | n/a | | | | | | | | [REDACTED] | 4 | * | * | | * | | | | [REDACTED] | 0 | | | | | | | | [REDACTED] | 0 | | | | | | | | [REDACTED] | 2 | * | | | | | | | [REDACTED] | 2 | | * | | | | | | [REDACTED] | 0 | | | | | | | | [REDACTED] | 0 | | | | | | | | [REDACTED] | 0 | | n/a | n/a | n/a | | | | [REDACTED] | 2 | * | | | | | | | [REDACTED] | 4 | * | * | * | | | | | [REDACTED] | 2 | * | n/a | n/a | n/a | | | ``` Last ran on: 2012-Mar-01 09:58:46 Z Displaying 1-100 of 148 page 1 of 2 (U//FOUO) Page Publisher: Identifier Scoreboard, T1422 | Content [REDACTED] T14 | Last Reviewed: 15-Dec-2010 | Last Modified: 23-Feb-2012 (U//FOUO) Derived From: NSA/CSSM 1-52 | Declassify On: 20320108 | Dated: 08 January 2007 Dynamic Page Highest Possible Classification is TOP SECRET//SI//REL TO USA, FVEY ``` TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 7 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## SIGINT Analytics Mode Triage by aggregate behaviors | Normalized identifier | Positive Results | Direct Comms with Target? | Targeted Contact? | In Captured Media? | [REDACTED] | Se | |-----------------------|------------------|---------------------------|-------------------|----------------------|------------|------| | [REDACTED] | 2 | * | n/a | n/a | n/a | | | [REDACTED] | n/a | | | | | | | [REDACTED]View detailed analytic results | 4 | Targets:
[REDACTED] TP
[REDACTED]

TP First heard: 25 Oct 2011
Last Heard: 09 Mar 2012 | | | [REDACTED]First heard: 03 Dec 2011
Last heard: 29 Feb 2012 | [REDACTED] | | | [REDACTED] | 3 | * | | | | | | [REDACTED] | n/a | | | | | | | [REDACTED] | 4 | * | * | | * | | | [REDACTED] | 2 | | * | | | | | [REDACTED] | 0 | | | | | | | [REDACTED] | 0 | | | | | | | [REDACTED] | 2 | * | | | | | | [REDACTED] | 2 | | * | | | | One column per 'yes/no' question Quickly zero in on worthy leads TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 8 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## SIGINT Analytics Mode - Detailed View ``` Dynamic Page - Highest Possible Classification Is TOP SECRET//SI//REL TO USA, FVEY About | Contact | A little help? SIGINT ANALYTICS Analytic Results: [REDACTED] 2012-Mar-01 09:58:46 Z [REDACTED] View in Target Profiler Had direct communications with a targeted identifier? [REDACTED] Seen in captured media? (no results) Seen in CNE? (no results) Seen in France? Seen on a targeted identifier's contact lists, or has a targeted contact? (no results) [REDACTED] Had direct communications with a targeted identifier? First heard: 2012-Mar-01 08:58:42 Z Last heard: 2012-Mar-05 07:55:40 Z ``` | Date | Description | Source | |------------------------|---------------------------------------------------------|--------| | 2012-Mar-05 07:55:40 Z | [REDACTED] cc'd email to [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200A/C4
Case notation: [REDACTED]
Legal authority category: EO12333 | | 2012-Mar-04 09:58:46 Z | [REDACTED] was bcc'd on email from [REDACTED]
[REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200A/C4
Case notation: [REDACTED]
Legal authority category: EO12333
| | 2012-Mar-02 10:56:43 Z | [REDACTED] received email from [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200B/C4
Case notation: [REDACTED]
Legal authority category: EO12333 | | 2012-Mar-01 08:58:42 Z |[REDACTED] sent email to [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: US-3171/T8
Case notation: [REDACTED]
Legal authority category: EO12333 | ``` Back to top (U//FOUO) Page Publisher: Identifier Scoreboard, T1422 | Content [REDACTED] T14 | Last Reviewed: 15-Dec-2010 | Last Modified: 23-Feb-2012 (U//FOUO) Derived From: NSA/CSSM 1-52 | Declassify On: 20320108 | Dated: 08 January 2007 Dynamic Page Highest Possible Classification is TOP SECRET//SI//REL TO USA, FVEY ``` TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 9 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## SIGINT Analytics Mode - Detailed View ``` Had direct communications with a targeted identifier? First heard: 2012-Mar-01 08:58:42 Z Last heard: 2012-Mar-05 07:55:40 Z ``` | Date | Description | Source | |------------------------|---------------------------------------------------------|--------| | 2012-Mar-05 07:55:40 Z | [REDACTED] cc'd email to [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200A/C4
Case notation: [REDACTED]
Legal authority category: EO12333 | | 2012-Mar-04 09:58:46 Z | [REDACTED] was bcc'd on email from [REDACTED]
[REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200A/C4
Case notation: [REDACTED]
Legal authority category: EO12333
| | 2012-Mar-02 10:56:43 Z | [REDACTED] received email from [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: DS-200B/C4
Case notation: [REDACTED]
Legal authority category: EO12333 | | 2012-Mar-01 08:58:42 Z |[REDACTED] sent email to [REDACTED] | UUID: [REDACTED]
SIGAD/PDDG: US-3171/T8
Case notation: [REDACTED]
Legal authority category: EO12333 | ``` Back to top ``` Go view target knowledge Go view content Add new knowledge External links to guide next steps in analysis TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 10 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## ECHOBASE Analytics Architecture Initial set of analytic questions * Most running within GHOSTMACHINE framework * Limited contributors * GHOSTMACHINE Analytic Engine provides * QFD hosting of analytic results * RESTful query interface Future analytics * multiple organizations/frameworks Daily Feeds Targeting * OCTAVE * UTT Targeted identifiers GHOSTMACHINE Selector List Seeds Seeded Analytic Seeded Analytic Analytic Analytic GM Analytic Engine QFD QFD QFD QFD QFD QFD Query QFDs Svc Bulk feeds of analytics results T12 CDP User DN, justification, leads & which QFDs ("domains") Log queries WAVELEGAL Check user authorizations CASport Check user authorizations Direct service query Future analytic service Future analytic ? Bulk feed of analytic results Non-GM Analytic FGS TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 11 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## 2012 Olympics Sharing GCHQ Releasable targeted identifiers Seeded Analytic Seeded Analytic Seeded Analytic Seeded Analytic Job Tracker (GCHQ architecture details omitted) NSA Lineup query details User DN, justification, leads & which QFDs ("domains") Daily Feeds Targeting * OCTAVE * UTT Targeted identifiers GHOSTMACHINE Selector List Seeds Seeded Analytic Seeded Analytic Analytic Analytic GM Analytic Engine QFD QFD QFD QFD QFD QFD Query QFDs Svc Bulk feeds of analytics results T12 CDP User DN, justification, leads & which QFDs ("domains") Log queries WAVELEGAL Check user authorizations CASport Check user authorizations Bulk feed of analytic results Non-GM Analytic FGS TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 12 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## 2012 Olympics Support * NSA SID Leads Evaluation Cell * Triage of Olympics-based leads through the event * Leverage both NSA and GCHQ-produced analytics * Greater SID-wide usage following the Olympic period TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 13 --- TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL ## Contact/Information - Briefers: - [REDACTED] - [REDACTED] - ECHOBASE Alias: - [REDACTED] - NSA WikiInfo page: - [REDACTED] TOP SECRET//COMINT//REL TO USA, CAN, AUS, GBR, NZL 14