first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
69
data/voip-in-xks/metadata.json
Normal file
69
data/voip-in-xks/metadata.json
Normal file
|
|
@ -0,0 +1,69 @@
|
|||
{
|
||||
"title": "VOIP in XKEYSCORE",
|
||||
"type": "REPORTED",
|
||||
"description": "A TOP SECRET XKeyscore training presentation from 2009 describing how the system intercepts internet phone calls — automatically matching the call setup information (who is calling whom) with the actual voice data even when they travel through different countries and collection sites, then decoding the audio into playable recordings that analysts can listen to through Windows Media Player.",
|
||||
"long_description": "This is a TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL XKeyscore training presentation dated March 2009. The document describes how XKeyscore handles Voice over IP collection — a technically challenging problem because VoIP call setup signalling and the actual voice data (RTP streams) frequently travel through different network routes and may be intercepted at entirely different collection sites around the world.\n\nThe presentation describes the supported VoIP protocols: SIP, H323, Skinny, Clarent and Yahoo proprietary for signalling/setup/control, with RTP for the actual voice, fax and video data streams. The XKeyscore solution operates in four steps. First, a local XKeyscore site identifies VoIP setup signalling involving a tasked target through dictionary hits from TRAFFICTHIEF, CADENCE, OCTAVE, MARINA or UTT. Second, the local XKeyscore instance queries itself for the corresponding RTP data. Third, if the RTP is not found locally, the query is passed back to headquarters (F6 HQS) for a cross-site query across the entire global XKeyscore network — spanning FORNSAT sites, SSO sites and F6 (Special Collection Service) sites. Fourth, matched RTP data is forwarded to NUCLEON (NSA's voice intercept repository) and summary reports are generated. The architecture diagram shows XKeyscore web servers, a dedicated VoIP box, and the F6 HQS coordinating queries across multiple F6 sites, FORNSAT sites and SSO sites.\n\nThe results screenshots show live intercepted VoIP calls from March 2009, including Yahoo Messenger voice calls between users with Yahoo email addresses and a call from a Pakistani phone number. The RTP viewer demonstrates the full decode pipeline: raw RTP packets using G.729 codec are extracted (9,733 packets, 194.7 seconds of audio), decoded from G.729 to WAV format, and presented for playback through Windows Media Player embedded in the XKeyscore interface. The VoIP Sigdev section describes additional search forms for discovery of untasked VoIP traffic — RTP, SIP, VoIP Setup and Wireshark searches — enabling analysts to find VoIP communications not already captured through dictionary targeting. The reference to F6 in both the architecture diagram and the headquarters coordination role confirms the Special Collection Service's central role in VoIP collection infrastructure.",
|
||||
"tags": [
|
||||
"VoIP",
|
||||
"RTP",
|
||||
"Skinny",
|
||||
"Clarent",
|
||||
"Yahoo Messenger",
|
||||
"codecs",
|
||||
"F6",
|
||||
"Special Collection Service",
|
||||
"FORNSAT",
|
||||
"SSO",
|
||||
"cross-site query",
|
||||
"audio intercept",
|
||||
"voice intercept",
|
||||
"SIGDEV",
|
||||
"Windows Media Player"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "2009-03-01",
|
||||
"classification": [
|
||||
"TOP SECRET",
|
||||
"COMINT"
|
||||
],
|
||||
"dissemination": [
|
||||
"REL TO USA, AUS, CAN, GBR, NZL"
|
||||
],
|
||||
"banner": "TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123",
|
||||
"genre": "slides",
|
||||
"programs": [
|
||||
"XKEYSCORE",
|
||||
"TRAFFICTHIEF",
|
||||
"CADENCE",
|
||||
"OCTAVE",
|
||||
"MARINA",
|
||||
"UTT",
|
||||
"NUCLEON",
|
||||
"SSO"
|
||||
],
|
||||
"countries": [
|
||||
"Pakistan"
|
||||
],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Intercept",
|
||||
"date_published": "2015-07-01",
|
||||
"title": "XKEYSCORE: NSA’s Google for the World’s Private Communications",
|
||||
"link": "https://theintercept.com/2015/07/01/nsas-google-worlds-private-communications/",
|
||||
"reporters": [
|
||||
"Marquis-Boire, Morgan",
|
||||
"Greenwald, Glenn",
|
||||
"Lee, Micah"
|
||||
],
|
||||
"contributors": [],
|
||||
"doc_source": "https://theintercept.com/document/2015/07/01/voip-xks/",
|
||||
"doc_url": "https://s3.documentcloud.org/documents/2116265/voip-in-xks.pdf"
|
||||
}
|
||||
],
|
||||
"aka_id": [],
|
||||
"pdf_sha256": "ffa6d6e34fd4b6a1c9d619ad2c59a67b375419d55b734fae104a743541ae25f8",
|
||||
"pages": 13
|
||||
}
|
||||
384
data/voip-in-xks/voip-in-xks.md
Normal file
384
data/voip-in-xks/voip-in-xks.md
Normal file
|
|
@ -0,0 +1,384 @@
|
|||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
|
||||
|
||||
XKEYSCORE
|
||||
|
||||
# VOIP in XKEYSCORE
|
||||
|
||||
March 2009
|
||||
|
||||
Derived From: NSA/CSSM 1-52
|
||||
Dated: 20070108
|
||||
Declassify On: 20291123
|
||||
|
||||
DERIVED FROM: NSA/CSSM 1-52
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123 08
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## Protocols
|
||||
|
||||
* Signaling/setup/control
|
||||
* SIP (Session Initiation Protocol)
|
||||
* H323
|
||||
* Skinny
|
||||
* Clarent
|
||||
* Yahoo proprietary
|
||||
* Data - voice, fax, video
|
||||
* RTP (Real-time Transport Protocol)
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## The Problem
|
||||
|
||||
* Setup and data may take different routes
|
||||
* Different routes may be collected at different sites
|
||||
* Routes may change
|
||||
|
||||
```
|
||||
Outbound
|
||||
Proxy Server
|
||||
|
||||
12
|
||||
200 OK
|
||||
Contact: B
|
||||
SDP B
|
||||
|
||||
Inbound
|
||||
Proxy Server
|
||||
|
||||
13
|
||||
200 OK
|
||||
Contact: B
|
||||
SDP B
|
||||
|
||||
11
|
||||
200 OK
|
||||
Contact: B
|
||||
SDP B
|
||||
|
||||
14
|
||||
ACK
|
||||
|
||||
User Agent A
|
||||
|
||||
User Agent B
|
||||
|
||||
Media (RTP)
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## XKS Solution
|
||||
|
||||
1. Local site XKS identifies VOIP setup involving a tasked target
|
||||
2. Local XKS queries itself for corresponding RTP data
|
||||
3. If the local query fails, it is passed back to HQS for a cross-site query across the entire XKS network
|
||||
4. Forward hits to NUCLEON and generate summary reports
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## XKS Solution
|
||||
|
||||
```
|
||||
If we did find the RTP, forward it
|
||||
back across all servers
|
||||
|
||||
VoIP box
|
||||
|
||||
If we found the RTP locally,
|
||||
forward it back.
|
||||
|
||||
XKEYSCORE web Server
|
||||
|
||||
Forward back results
|
||||
|
||||
F6 HQS
|
||||
|
||||
FORNSAT site
|
||||
|
||||
SSO site
|
||||
|
||||
F6 Site 1
|
||||
|
||||
F6 Site 2
|
||||
|
||||
queries itself for the RTP on a hit
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits
|
||||
|
||||
Use this to find data for which...
|
||||
|
||||
* There was a dictionary hit on the VOIP signaling (TRAFFICTHIEF, CADENCE, OCTAVE, MARINA, UTT)
|
||||
* ... AND ...
|
||||
* We were able to find the RTP corresponding to the signaling information
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits
|
||||
|
||||
XKEYSCORE Welcome: oper switch users
|
||||
|
||||
```
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//203201
|
||||
XKEYSCORE Welcome: oper switch users
|
||||
Home Admin Users Workflow Central Search Results Statistics Preferences Help
|
||||
|
||||
Navigation Menu
|
||||
Search
|
||||
Classic
|
||||
Common
|
||||
Dictionary Hits
|
||||
File Transfer
|
||||
MultiSearch
|
||||
Network Management
|
||||
Search Wizard
|
||||
User Activity
|
||||
VoIP
|
||||
Hits
|
||||
Sigdev
|
||||
Wireless
|
||||
|
||||
Search: Voip
|
||||
Query Name: oper_0
|
||||
Justification:
|
||||
Additional Justification:
|
||||
Miranda Number:
|
||||
|
||||
Datetime: 1 Day Start: 2009-03-04 00:00 Stop:
|
||||
|
||||
Email: From
|
||||
Email: To
|
||||
|
||||
Name: From
|
||||
Name: To
|
||||
|
||||
Phone Number: From
|
||||
Phone Number: To
|
||||
|
||||
Country Phone Number: From
|
||||
Country Phone Number: To
|
||||
|
||||
Tasking Type:
|
||||
Tasking Value:
|
||||
Dictionary:
|
||||
Category:
|
||||
Priority:
|
||||
Target:
|
||||
Description:
|
||||
Contacts:
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits - Search Form
|
||||
|
||||
* User/target information
|
||||
* Email
|
||||
* Name
|
||||
* Phone number
|
||||
* IP address
|
||||
* Country code
|
||||
* Content information
|
||||
* Content type (audio, video, image)
|
||||
* Control type (SIP, H323, skinny, clarent)
|
||||
* Fingerprints - may indicate specific VOIP devices
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits - Results
|
||||
|
||||
| ID | Datetime | Datetime End | Content | From Email | From Name | From Phone# | From Country# | To Email |
|
||||
| --- | ------------------- | -------------------- | --------- | ----------- | --------- | ----------- | ------------- | --------- |
|
||||
| 91 | 2009-03-03 05:05:28 | 2009-03-03 05:08:42 | 🎧 | d @yahoo | "d " | | | h @yahoo |
|
||||
| 92 | 2009-03-03 06:41:22 | 2009-03-03 06:42:33 | | a @yahoo | "a " | | | s @yahoo |
|
||||
| 93 | 2009-03-03 09:39:09 | 2009-03-03 09:48:05 | | b @yahoo | b | | | s @yahoo |
|
||||
| 94 | 2009-03-03 09:36:01 | 2009-03-03 09:37:09 | | b @yahoo | b | | | s @yahoo |
|
||||
| 95 | 2009-03-03 10:02:31 | 2009-03-03 10:02:52 | | b @yahoo | b | | | s @yahoo |
|
||||
| 96 | 2009-03-03 12:57:27 | 2009-03-03 12:57:41 | | o @yahoo | "o " | | | g @yahoo |
|
||||
| 97 | 2009-03-03 05:05:28 | 2009-03-03 05:08:42 | | d @yahoo | "d | | | h @yahoo |
|
||||
| 98 | 2009-03-03 06:41:22 | 2009-03-03 06:42:33 | | a @yahoo | "a " | | | s @yahoo |
|
||||
| 99 | 2009-03-03 07:50:18 | 2009-03-03 07:50:18 | | 0092 @ .23 | | 9234 | pakistan | 6661 |
|
||||
| 100 | 2009-03-03 07:50:18 | 2009-03-03 08:04:15 | 🎧 | 0092 @ .23 | | 9234 | pakistan | 6661 |
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits - RTP Viewer
|
||||
|
||||
```
|
||||
Reports ▾ View ▾
|
||||
```
|
||||
|
||||
| State ID | Datetime | Datetime End | Content | From Er |
|
||||
|----------|----------------------|----------------------|---------|---------|
|
||||
| 91 | 2009-03-03 05:05:28 | 2009-03-03 05:08:42 | 🎧 | d |
|
||||
| 92 | 2009-03-03 06:41:22 | 2009-03-03 06:42:33 | | a |
|
||||
| 93 | 2009-03-03 09:39:09 | 2009-03-03 09:48:05 | | b |
|
||||
| 94 | 2009-03-03 09:36:01 | 2009-03-03 09:37:09 | | b |
|
||||
| 95 | 2009-03-03 10:02:31 | 2009-03-03 10:02:52 | | b |
|
||||
|
||||
```
|
||||
X-KEYSCORE C2C Session Viewer
|
||||
|
||||
Session 1 of 160
|
||||
Datetime | Case Notation | From IP | To IP | From Port | To Port | Pro |
|
||||
2009-03-03 05:05:28 | 0000000 | .61.149 | .11.214 | 10122 | 8052 | UD |
|
||||
|
||||
Session | Header (3) | Meta (4)
|
||||
|
||||
Format: AUTO Send to: Download Session | Mode: Snippet | Options | Search Content: Enter text to search
|
||||
|
||||
Quick Clicks
|
||||
* Session
|
||||
* One-Click Searches
|
||||
* Find opposite side of sessi
|
||||
* 61.149:10122 -
|
||||
* 11.214:80.
|
||||
* Find traffic on
|
||||
* .11.214
|
||||
* .61.149
|
||||
* Find application
|
||||
* multimedia/rtp/g729
|
||||
* Find fingerprint
|
||||
* region/
|
||||
|
||||
AUTO FORMATTER: app_id= multimedia/rtp/g729 Viewer = RTP formatter. Info=
|
||||
|
||||
Extracting RTP data...
|
||||
|
||||
ssrc # packets % packets # bytes % bytes min ts max ts min seq max seq
|
||||
39c4 9733 100.0% 194650 100.0% 1895262977 1896820097 0 65535
|
||||
|
||||
payload # packets % packets # bytes % bytes min ts max ts min seq max seq
|
||||
g729 9733 100.0% 194650 100.0% 1895262977 1896820097 0 65535
|
||||
Number of bad sequence numbers=2
|
||||
|
||||
Decoding media...
|
||||
|
||||
39c4 g729: raw decoded wav decoded au [194.7 sec] audio processing
|
||||
combined g729: raw decoded wav decoded au [9.3 sec] audio processing
|
||||
00000000 g729: raw decoded wav decoded au [0.0 sec] audio processing
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
**Page 11**
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Hits - audio
|
||||
|
||||
```
|
||||
Date
|
||||
-03 05:05:28 2009
|
||||
-03 06:44:22 2000
|
||||
-03 09:3 Audio
|
||||
-03 09:3
|
||||
|
||||
Now Playing
|
||||
get_session_new.php
|
||||
Media Guide
|
||||
Copy from CD
|
||||
Media Library
|
||||
get_session_new.php
|
||||
Radio Tuner
|
||||
get_session_new.php
|
||||
3:14
|
||||
Copy to CD or Device
|
||||
Premium Services
|
||||
Skin Chooser
|
||||
Ambience: Bubble
|
||||
Playing 00:11
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## VOIP Sigdev
|
||||
|
||||
Use these search forms to find other VOIP not included in the VOIP Hits
|
||||
|
||||
* RTP
|
||||
* SIP
|
||||
* VOIP Setup
|
||||
* Wireshark
|
||||
|
||||
```
|
||||
Home Admin Users Workflow
|
||||
Navigation Menu
|
||||
Search
|
||||
Classic
|
||||
Common
|
||||
Dictionary Hits
|
||||
File Transfer
|
||||
MultiSearch
|
||||
Network Management
|
||||
Search Wizard
|
||||
User Activity
|
||||
VoIP
|
||||
Hits
|
||||
Sigdev
|
||||
RTP
|
||||
SIP
|
||||
Voip Setup
|
||||
Wireshark
|
||||
Wireless
|
||||
```
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
|
||||
## Questions?
|
||||
|
||||
* Contact the team:
|
||||
* xkeyscore@nsa.ic.gov
|
||||
* http://xkeyscore.[REDACTED] (go xkeyscore)
|
||||
* Primary POCs for VOIP:
|
||||
* [REDACTED]@nsa.ic.gov
|
||||
* [REDACTED]@nsa.ic.gov
|
||||
|
||||
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
|
||||
Loading…
Add table
Add a link
Reference in a new issue