first commit

This commit is contained in:
libroot 2026-11-19 04:39:11 +02:00
commit 0d90363116
Signed by: libroot
GPG key ID: 2AC68C029EBE9ACE
6510 changed files with 679146 additions and 0 deletions

View file

@ -0,0 +1,190 @@
TOP SECRET//COMINT//REL TO USA, FVEY//20320108
NATIONAL SECURITY AGENCY
UNITED STATES OF AMERICA
# Content Extraction Enhancements For Target Analytics:
## SMS Text Messages: A Goldmine to Exploit
9 June, 2011
Presenters: [REDACTED]
With
[REDACTED]
Work funded by T1221 Center for Content Extraction
Performed in Collaboration with
[REDACTED] T1221 Center for Content Extraction
[REDACTED] T132 Dishfire
Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20341201
TOP SECRET//COMINT//REL TO USA, FVEY//20320108
---
SECRET//COMINT//REL TO USA, FVEY//20320108
## (U) OUTLINE
* (U) Introduction & Some Statistics
* (U) Missed Call Messages
* (U) MilkBone QFD “Demo”
* (U) Where Next?
2
SECRET//COMINT//REL TO USA, FVEY//20320108
---
UNCLASSIFIED
## (U)SMS (Short Message Service)
### some stats
* (U) (May 2011): Mobile phone subscriptions have reached 5.3 billion, 77% of the world population. Growth led by China and India.
* (U) 500 million people accessed mobile internet worldwide in 2009. Usage is expected to double in 5 years. 1/2011: 200 million users access Facebook using mobile.
* (U)(Oct. 2010) Many mobile Web users are mobile-only (rarely use desktop, laptop or tablet to access the Web|). Mobile-only in Egypt is 70%, India 59% and US 25%. Mobile penetration in the developing world is now at 68%,
* (U) SMS is still king of mobile messaging - 6.1 trillion messages sent in 2010 (200,000 text messages per second) and is expected to exceed 10 trillion in 2013 (1.8 trillion sent in 2007). Most number of texts are sent in the Philippines and US.
* (U) Mobile phone providers in developing countries increasingly use the mobile phone for health services and banking (International Telecommunications Union)
* (U) Many mobile web users do not have a bank account (India 57%). Gartner predicts that the number 1 service in 2010 will be money transfer using SMS. Estimate 2009 55 million users and various organizations predict doubling every year estimate 2013 around 5 million user). Initiatives to bank the unbanked.
* (U) The typical mobile subscriber sends and receives more SMS text messages than telephone calls. The average U.S. mobile customer sent or received 357 text messages in 2008 (a 450% increase over 2006) and placed/received 204 calls. In 2010, the average American teen sent or received 3,339 texts per month, > 6 per hour.
* (U) 2008 estimate of text message usage among wireless subscribers: Russia - 88%, UK - 76%, China – 72%, Brazil - 60%, USA – 53%
UNCLASSIFIED
---
SECRET//COMINT//REL TO USA, FVEY//20320108
## (U) SMS Message Components
* (U) SMS Metadata
* (U) IMSI: International Mobile Subscriber Identity (most frequent)
* (U) MSISDN: Mobile Subscriber Integrated Services Digital Network Number, i.e., phone number
* (U) IMEI: International Mobile Equipment Identity
* (U) SME: Short Message Entity (entities which can send & receive messages)
* Content
* (U) Typed Text Message
* (U) User entered
* (U) System Generated
* (U) Useful (personal) [Ham]
* (U) Spam
SECRET//COMINT//REL TO USA, FVEY//20320108
---
SECRET//COMINT//REL TO USA, FVEY//20320108
## (U) Why?
(U//FOUO) SMS Message
METADATA:
MSISDN (phone #)
IMSI (person id)
IMEI (equipment)
METACONTENT:
Message Content
* (S//REL) Metadata + Content of System Generated Text Messages leads to analytic gems => content derived metadata
* (S//SI//REL) Such gems often are not in current metadata stores and would enhance current analytics: contact chaining, geolocation, alternative identifiers (including DNI & DNR links), travel, finance
* (S//REL) SMS: Rich data set, high impact. Usage is increasing. Features & Notifications available on mobile phones are increasing → rich data set awaiting exploitation.
5
SECRET//COMINT//REL TO USA, FVEY//20320108
---
SECRET//COMINT//REL TO USA, FVEY//20320108
## (U) PREFER
* (U//FOUO) Identifies types of automated messages
* (U//FOUO) Extracts entities from SMS content daily:
* (S//REL) Results presented averaged over 30 days (April 2011)
* 194,184,810 - sms messages per day (not deduped)
* 184,794,279 - DISHFIRE message tags
* 188,299,963 - PREFER text slice decoded
* (S//REL) PREFER operational on DISHFIRE servers since January 2008, inserting content derived tags into xml output. First major utilization, SPYDER 2008 for selected content.
6
SECRET//COMINT//REL TO USA, FVEY//20320108
---
SECRET//COMINT//REL TO USA, FVEY//20320108
## (U) How Does PREFER Fit
```
SECRET//SI//REL
Collection
Discover the
Targets
DISHFIRE
(SMS repository)
Extract Useful
Information
PREFER
Extraction:
-message
recombination
-"metadata" from
content
Follow the Targets
Existing
Tools/Databases
MetaContent
QFDs
DISHFIRE
SPYDER
SEDB
FASTCOPE Innovations
MILKBONE
SECRET//SI//REL
```
SECRET//COMINT//REL TO USA, FVEY//20320108
---
TOP SECRET//COMINT//REL TO USA, FVEY//20320108
## (U//FOUO) PREFER
### Identification & Extraction April 2011
(S//SI//REL) 194 Million Messages Collected by DISHFIRE per Day, Including
* (S//SI//REL) VCARDS → names+; (113,672 average extracted daily) sometimes DNI link (email) to DNR (telephony) as well as images
[REDACTED]
* (S//SI//REL) Geocoordinates (76,142 daily avg; hex-encoded 10.432) [REDACTED]
* Requests by people for route info
* Setting up meetings at a location
* Tracking information: e.g., [REDACTED] (12,809)
* Comma Separated Formats (33,020)
* (S//SI//REL) Missed Calls → contact chaining (5,058,114)
* (S//SI//REL) SIM Card Changes → IMSI/IMEI links (6,017,901)
* (S//SI//REL) Roaming information → border crossings (1,658,025)
* (S//SI//REL) Travel (5,314)
* Itinerary including multiple flights
* Changes: cancellations, reschedules, delays
* (S//SI//REL) Financial Transactions:
* Credit card transactions: correlate credit cards to individuals (61,488)
* Money transfers (social networks) - Phone to Phone (630,846)
* Track financial information (account activity - bank transaction) (115,480)
* (S//SI//REL) Passwords (pending); Other Requests?
8
TOP SECRET//COMINT//REL TO USA, FVEY//20320108

View file

@ -0,0 +1,86 @@
{
"title": "Content Extraction Enhancements For Target Analytics: SMS Text Messages: A Goldmine to Exploit (9 June 2011)",
"type": "REPORTED",
"description": "The document describes the NSA’s Dishfire program, which collects hundreds of millions of global SMS messages daily, and the PREFER system, which extracts detailed metadata—including contacts, geolocation, travel, and financial information—from these messages for analytic purposes. It highlights the scale, operational processes, and types of data exploited to support intelligence and target analysis.",
"long_description": "This document provides an in-depth overview of the NSA’s DISHFIRE program and its associated PREFER system, which together facilitate the large-scale collection and analysis of global SMS communications. DISHFIRE functions as a massive repository for short message service (SMS) data, gathering hundreds of millions of text messages daily, including system-generated messages such as missed call alerts, roaming notifications, and itineraries. PREFER operates on top of DISHFIRE, automatically extracting “content-derived metadata” from these messages, generating actionable intelligence such as contact networks, geolocation, travel plans, credit card transactions, and other personal identifiers.\n\nThe document details the operational scale and technical methods, noting that, as of April 2011, DISHFIRE collected an average of approximately 194 million messages per day. Extracted metadata includes vCards (names and contact information), geocoordinates, travel-related information, SIM card changes, roaming data, financial transactions, and even certain password-related data. The material emphasizes the strategic value of these “analytic gems” in enhancing contact chaining, target tracking, and broader intelligence operations, highlighting the growing relevance of SMS communications as a rich data source for surveillance. Additionally, it references other supporting tools and programs, including SPYDER, SEDB, FASTCOPE, and MILKBONE, which integrate with DISHFIRE and PREFER to improve the efficiency of intelligence extraction.\n\nOverall, the document illustrates how NSA leverages automated systems to exploit both the content and metadata of mobile communications at a global scale, revealing the depth, breadth, and operational sophistication of its text message surveillance capabilities.",
"tags": [
"SMS",
"Facebook",
"mobile phones",
"SMS interception",
"metadata extraction",
"geolocation",
"contact chaining",
"cryptanalysis",
"FASTCOPE Innovations",
"financial transactions",
"international roaming",
"mobile communications",
"content-derived metadata",
"vCards",
"travel tracking",
"global surveillance",
"target analysis"
],
"document": {
"creator": "NSA",
"date_created": "2011-06-09",
"classification": [
"TOP SECRET",
"COMINT"
],
"dissemination": [
"REL TO USA, FVEY"
],
"banner": "TOP SECRET//COMINT//REL TO USA, FVEY//20320108",
"genre": "slides",
"programs": [
"MILKBONE",
"DISHFIRE",
"PREFER",
"SPYDER",
"SEDB",
"FASTCOPE"
],
"countries": [
"China",
"India",
"Egypt",
"Philippines",
"Russia",
"United Kingdom",
"Brazil"
],
"people": []
},
"publication": [
{
"publisher": "The Guardian",
"date_published": "2014-01-16",
"title": "NSA collects millions of text messages daily in 'untargeted' global sweep",
"link": "https://www.theguardian.com/world/2014/jan/16/nsa-collects-millions-text-messages-daily-untargeted-global-sweep",
"reporters": [
"Ball, James"
],
"contributors": []
},
{
"publisher": "Channel 4 News",
"date_published": "2014-01-17",
"title": "Revealed: UK and US spied on text messages of Brits",
"link": "https://www.channel4.com/news/intercept-text-messages-spy-nsa-gchq-british-phone",
"reporters": [
"White, Geoff"
],
"contributors": [],
"reporting_only": true
}
],
"aka_id": [
{
"id": "nsa-sms-exploit"
}
],
"pdf_sha256": "1ec806c77619310f63bae9109ff55ace02901c263cd963802062e86963f6aaa8",
"pages": 8
}