first commit

This commit is contained in:
libroot 2026-11-19 04:39:11 +02:00
commit 0d90363116
Signed by: libroot
GPG key ID: 2AC68C029EBE9ACE
6510 changed files with 679146 additions and 0 deletions

View file

@ -0,0 +1,94 @@
{
"title": "SKYNET: Applying Advanced Cloud-based Behavior Analytics",
"type": "REPORTED",
"description": "A classified NSA SIGINT Development presentation detailing SKYNET, a cloud-based machine learning system that analyzes bulk Pakistani call data records to identify suspected couriers and terrorists through automated travel pattern analysis, behavioral profiling, and social network mapping — with the goal of supporting targeting operations against groups including the Haqqani Network.\n",
"long_description": "This top secret NSA SIGINT Development presentation describes SKYNET, a collaborative cloud analytics project spanning five NSA organizations across three directorates — Signals Intelligence, Research, and Technology — with external partnerships including MIT Lincoln Labs and Harvard University. The system's core function is the application of geospatial, geotemporal, pattern-of-life, and travel analytics to bulk call data records (CDRs) acquired from major Pakistani telecommunications providers through a dataflow called DEMONSPIT. Raw CDRs are normalized through TUSKATTIRE and distributed across multiple cloud systems including GMHalo, GMPlace, Cloud 14, and Bulldozer/MDR2, with processed data flowing into analyst-facing tools including MAINWAY, FASCIA, JEMA, CINEPLEX, SMARTTRACKER, and SORTINGLEAD.\n\nThe analytical framework SKYNET applies is built around a set of behavioral indicators associated with courier and terrorist activity: regular travel between specific cities on fixed schedules, frequent SIM or handset swapping, excessive phone power-downs, low usage with incoming calls only, co-traveler identification, and proximity to known tasked selectors. The document presents specific operational use cases focused on the Peshawar-Lahore-Faisalabad corridor and courier routes between Afghanistan and Pakistan, including a map of a described courier path spanning provinces from Baghlan and Konarha through Kabul, Jalalabad, Peshawar, Lahore, and into Waziristan. Sample travel reports show SKYNET applied against Haqqani Network-associated selectors, with results including IMSI numbers, contact counts, selector swapping behavior, and travel phrases across Afghanistan, Pakistan, Iran, Bahrain, and the UAE.\n\nThe triage workflow integrates three tools sequentially: SMARTTRACKER identifies co-location coincidences between suspects across time and cell tower locations; RT-RG analytics identify meeting partners and traveling pairs (\"sidekicks\") at destination cities; and JEMA serves as the integrating human-in-the-loop environment where analysts evaluate travel reports, prioritize selectors, and generate targeting leads. The document includes a coincidence report showing one redacted target co-located with others at up to 24 distinct locations 101 times — illustrating the granularity of behavioral mapping the system enables against individuals who have not yet been formally tasked as targets.",
"tags": [
"pattern-of-life",
"travel analytics",
"call detail records",
"bulk collection",
"Haqqani Network",
"courier tracking",
"machine learning",
"cloud analytics",
"behavioral profiling",
"SIM swapping",
"GSM",
"handset swapping",
"geolocation",
"cell towers",
"IMSI",
"MSISDN",
"counterterrorism",
"targeting",
"social network analysis",
"co-travelers",
"metadata analysis"
],
"document": {
"creator": "NSA",
"date_created": "",
"classification": [
"TOP SECRET",
"COMINT"
],
"dissemination": [
"REL TO USA, AUS, CAN, GBR, NZL"
],
"banner": "TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL",
"genre": "slides",
"programs": [
"SKYNET",
"DEMONSPIT",
"TMAC",
"FASTSCOPE",
"TUSKATTIRE",
"GMHALO",
"GMPLACE",
"BULLDOZER",
"MDR2",
"CINEPLEX",
"JEMA",
"FASCIA",
"CLOUD",
"DPS",
"SEDB",
"SMARTTRACKER",
"SORTINGLEAD",
"ASSOCIATION",
"BANYAN",
"SMARTTRACKER",
"RT-RG",
"SNOWHAZE",
"MASTERSHAKE",
"MAINWAY"
],
"countries": [
"Afghanistan",
"Pakistan",
"Iran",
"Bahrain",
"United Arab Emirates"
],
"people": []
},
"publication": [
{
"publisher": "The Intercept",
"date_published": "2015-05-08",
"title": "U.S. Government Designated Prominent Al Jazeera Journalist as \"Member of Al Qaeda\"",
"link": "https://theintercept.com/2015/05/08/u-s-government-designated-prominent-al-jazeera-journalist-al-qaeda-member-put-watch-list/",
"reporters": [
"Currier, Cora",
"Greenwald, Glenn",
"Fishman, Andrew"
],
"contributors": [],
"doc_source": "https://theintercept.com/document/2015/05/08/skynet-applying-advanced-cloud-based-behavior-analytics/",
"doc_url": "https://s3.documentcloud.org/documents/2074625/skynet-applying-advanced-cloud-based-behavior.pdf"
}
],
"pdf_sha256": "d3699e74af2ba8c621452d3dcc07bacdf8b0846060fc020793b8b364dd330b59",
"pages": 20
}

View file

@ -0,0 +1,474 @@
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
NATIONAL SECURITY AGENCY
UNITED STATES OF AMERICA
NATIONAL SECURITY AGENCY
SIGDEV
SIGINT DEVELOPMENT
# SKYNET: Applying Advanced Cloud-based Behavior Analytics
A Collaborative Project by S2I, R6, T12, T14, SSG, and S22
Presenters:
* [REDACTED], S2I51
* [REDACTED], R66F
SIGINT Development
SSG Governance and
Enterprise Management
MASTERSHAKE
Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20370401.
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
UNCLASSIFIED//FOUO
## Outline
* What is SKYNET?
* DEMONSPIT Data Flow
* Automated Bulk Cloud Analytics
* Analytic Triage
UNCLASSIFIED//FOUO
---
## What is SKYNET?
* Collaborative cloud research effort between 5 different organizations crossing 3 NSA Directorates:
* Signals Intelligence: S21, S22, SSG
* Research: R6
* Technology: T12, T14
* Partnerships
* TMAC/FASTSCOPE
* MIT Lincoln Labs & Harvard
* SKYNET applies complex combinations of geospatial, geotemporal, pattern-of-life, and travel analytics to bulk DNR data to identify patterns of suspect activity
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
CTMMC
NSA/CSS Counterterrorism
Mission Management Center
Intelligence Update
Rough outline of courier path as described by the targets
```
Baghlan
Konarha
Kapisa
Laghman
Asadabad
Mahmud-E Eraqi
Parvan Charikar
Kabul
Mehtar Lam
Jalabad
Nangarhar
Peshawar
Lowg
Baraki Barak
Tuesday/Friday
[REDACTED]
Gardez
Paktia
Waziristan
[REDACTED]
Paktika
[REDACTED]'s Courier
Islamabad
Rawalpindi
Srinagar
Azad Kashmir Province
Jammu &
Sunday
Probably Faisalabad
[REDACTED]
Faisalabad
Lahore
[REDACTED]
Sunday/Monday
Chand
Haryana
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//ORCON/REL TO USA, AUS, CAN, GBR, NZL
## SKYNET Analytic Questions
* Who has traveled from Peshawar to Faisalabad or Lahore (and back) in the past month?
* Who does the traveler call when he arrives?
* Who else is seen in the area when the traveler arrives, and who seen leaving the area shortly afterward?
* Who travels to/from Peshawar every other Sunday and "somewhere else“ on a weekly basis?
* Who visits Akora Khattak periodically and also travels between Peshawar and Lahore?
* Who fits the above travel profiles and also possesses unusual behavior:
* One or two hops from other suspects or known tasked selectors
* Frequent handset swapping or powering down
TOP SECRET//COMINT//ORCON/REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
## DEMONSPIT
* DEMONSPIT is a new dataflow for bulk Call Data Records (CDRs) from Pakistan
* CDRs are being acquired from major PK Telecom providers
* Data is normalized through TUSKATTIRE, like all other Call Data Records
* DEMONSPIT data is forwarded by TUSKATTIRE to several Clouds:
* GMHalo/DPS
* Promotes records to FASCIA and feeds the SEDB Tower QFD
* GMPlace & Cloud 14
* Ingests DEMONSPIT into Sortinglead summaries to support SKYNET Analytics
* Ingests DEMONSPIT into a Perishable QFD which will be available to analysts via JEMA and CINEPLEX
* Bulldozer/MDR2
All of the clouds receiving DEMONSPIT data also receive all FASCIA data
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
## Analysts' View of DEMONSPIT
TUSKATTIRE
TOWER QFD
ROLLERCOASTER
R6 CLOUD 14
FASCIA
Original CDRs
Original CDRs
Access to CDRs, Analyst Queries, & Results of SKYNET Analytics
CDR Summaries
Analyst Promoted CDRs
SKYNET & Analyst Promoted CDRs
Access to ALL DEMONSPIT Data
MAINWAY/SIGNAV
JEMA
CINEPLEX
SMARTTRACKER
SORTINGLEAD
Access to DEMONSPIT FASCIA Promoted Data
ASSOCIATION
BANYAN
SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
UNCLASSIFIED//FOUO
## Outline
* What is SKYNET?
* DEMONSPIT Data Flow
* **Automated Bulk Cloud Analytics**
* Analytic Triage
UNCLASSIFIED//FOUO
---
TOP SECRET//SI//REL TO USA, FVEY
## Cloud Analytic Building Blocks
* Travel Patterns
* Travel phrases (Locations visited in given timeframe)
* Regular/repeated visits to locations of interest
* Behavior-Based Analytics
* Low use, incoming calls only
* Excessive SIM or Handset swapping
* Frequent Detach/Power-down
* Courier machine learning models
* Other Enrichments
* Travel on particular days of the week
* Co-travelers
* Similar travel patterns
* Common contacts
* Visits to airports
* Other countries
* Overnight trips
* Permanent move
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## Sample Travel Report: Haqqani Network
| IMSI | seed-contacts | tasked-contact-count | selector_swapping_num | associated_selectors | visits_regularly | other_countries | phrase |
| ---------- | ------------- | -------------------- | --------------------- | -------------------- | ---------------- | --------------- | --------------------------------------------------------- |
| [REDACTED] | [REDACTED] | 3 | 3 | [REDACTED] | lashkargah_city | | helmand kandahar AF PK |
| [REDACTED] | [REDACTED] | 14 | | | nowbahar | IR | farah AF bala_bulk farah masow farah masow nowbahar masow |
| [REDACTED] | [REDACTED] | 5 | 3 | [REDACTED] | | BA | ghazni AF sharan urgon |
| [REDACTED] | [REDACTED] | 1 | | | | AE | AF khost_airport kajir_kalay |
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## What Suspicious Selectors Were Seen Traveling Between Peshawar and Lahore?
Case-Specific Behavioral Cloud Analytics
Peshawar-Lahore Travel 1 - 4 NOV 2011
| TRAVEL PHRASE | DOW | MSISDN | IMSI | TASKED CONTACTS | NUM_SELECTOR_SWAPPING | ASSOCIATED_SELECTORS | ACTIVITY_CATEGORIES |
|------------------------------------------------------------------------------------------------------|-----|------------|------------|-----------------|-----------------------|----------------------|--------------------------------------------------------------|
| torkham AF PK peshawar lahore | FRI | [REDACTED] | | 2 | | | |
| PK peshawar lahore | THU | [REDACTED] | | | | | |
| behsud AF jalalabad jalal_abad jalalabad behsud rodat bati_kot mohmand_darah peshawar PK | WED | | [REDACTED] | 4 | 7 | [REDACTED] | |
| gtrd PK nowshera gulbahar peshawar sanda_kalan lahore | THU | [REDACTED] | | | | | |
| jamrud PK peshawar lahore | TUE | [REDACTED] | | 10 | | | |
| PK peshawar lahore | THU | | [REDACTED] | | | | 5-or-fewer-contacts, sms-and-zero-duration-calls-only, low-use |
TOP SECRET//SI//REL TO USA, FVEY
---
UNCLASSIFIED//FOUO
## Outline
* What is SKYNET?
* DEMONSPIT Data Flow
* Automated Bulk Cloud Analytics
* **Analytic triage**
* **SMARTTRACKER**
* **RT-RG**
* **JEMA**
UNCLASSIFIED//FOUO
---
TOP SECRET//SI//REL TO USA, FVEY
## Selectors of Interest from Cloud Travel Analytic
[REDACTED]
[REDACTED] (tasked)
[REDACTED]
IMSIs:
[REDACTED]
Handsets:
[REDACTED]
[REDACTED]
[REDACTED]
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## SMARTTRACKER Travel View
31 October – 23 November
* Location: UCell ID [REDACTED] 2 (11/14/2011 04:27:47)
* Location: UCell_ID [REDACTED] 14 (11/20/2011 12:59:04)
14 (11/20/2011 12:59:04)
* Location: UCell_ID [REDACTED] 4 (11/14/2011 02:19:16)
* Location: UCell_ID 410.006.00403.20393 30 (11/23/2011 14:23:55)
* Location: UCell ID [REDACTED] 104 [REDACTED]-TASKED AFGH[REDACTED] (11/21/2011 14:55:37)
* Location: UCell_ID [REDACTED] 1 (11/20/2011 18:34:15)
1 (11/20/2011 18:34:15)
```
AKORA KHATTAK SUSPECT TERRORIST FACILITY 001
Miles 20 40 60 80
Km 100
31 29 2.7713 N, 75 13 45.1982 E
MUZAFFARABAD, labels, KARGIL, SRINAGAR, CHAKDALA, BANIHAL, JAMMU, SHEIKHUPURA, Pathankot, KUNGRA, FAISALABAD, LAHORE, AMBITSAR, VADAMPUR, LUDHIANA, OKARA, RAFIQUI, DERA ISMAIL KHAN, BANNU, WANA, PESHAWAR, SALPUR, TARBELA DAM
```
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## Analytic Tradecraft
* Examine travel patterns for common routes and meeting locations
* Run cell soaks on all common meeting locations during meeting timeframe
* Analyze selectors for common contacts
* Analyze selectors for handset sharing behavior
Repeat procedure with resulting selectors
Correlate with other known and suspected selectors
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## SMARTTRACKER
Coincidence Report
| | | Who | Coincidence Count |
|---------------------|--------|------------|------------------------|
| Sets with 3 targets | Select | [REDACTED] | 1 at 1 location |
| Sets with 2 targets | Select | [REDACTED] | 101 at 16 locations |
| | Select | [REDACTED] | 91 at 20 locations |
| | Select | [REDACTED] | 39 at 24 locations |
| | Select | [REDACTED] | 37 at 12 locations |
| | Select | [REDACTED] | 33 at 12 locations |
| | Select | [REDACTED] | 31 at 12 locations |
| | Select | [REDACTED] | 24 at 11 locations |
| | Select | [REDACTED] | 1 at 1 location |
| | Select | [REDACTED] | 1 at 1 location |
| | Select | [REDACTED] | 1 at 1 location |
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## SMARTTRACKER
Smart Chart
```
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
0
Oct Nov
31 01 02 03 04 05 06 07 08 09 10
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
0
OcNov
31 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23
```
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## RT-RG Analytics
Meetings – who is at the same ucellid at the same time as the potential courier at the destination city?... Multiple times.
Sidekicks – is there a pair traveling together to the destination city?
TOP SECRET//SI//REL TO USA, FVEY
---
TOP SECRET//SI//REL TO USA, FVEY
## JEMA: Pulling It All Together
```
AOI Start/end points
AOIs Dates
Movement Irregularity
seeds
Travel Reports
Human in the loop to analyze travel reports.
Destination Cities
AOIs
Seeds + phrases
Seeds + phrases
Meetings
Sidekicks
Evaluate, add value, prioritize
Are selectors seen meeting at destination consistently?
Does Sidekick selector have call events?
```
TOP SECRET//SI//REL TO USA, FVEY
---
UNCLASSIFIED//FOUO
## THANK YOU!
SKYNET WIKI:
https://[REDACTED]/wiki/SKYNET
[REDACTED], S2I51, [REDACTED]@nsa.ic.gov
[REDACTED], R66F, [REDACTED]@nsa.ic.gov
SNOWHAZE
UNCLASSIFIED//FOUO