first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
|
|
@ -0,0 +1,84 @@
|
|||
TOP SECRET//SI//NOFORN
|
||||
|
||||
# Address Books
|
||||
|
||||
* Email address books for most major webmail are collected as stand-alone sessions (no content present\*)
|
||||
* Address books are repetitive, large, and metadata-rich
|
||||
* Data is stored multiple times (MARINA/MAINWAY, PINWALE, CLOUDS)
|
||||
* Fewer and fewer address books attributable to users, targets
|
||||
* Address books account for ~ 22% of SSO's major accesses (up from ~ 12% in August)
|
||||
|
||||
| Access (10 Jan 12) | Total Sessions | Address Books |
|
||||
| :------------------ | :------------- | :------------------------ |
|
||||
| US-3171 | 1488453 | 237067 (16% of traffic) |
|
||||
| DS-200B | 938378 | 311113 (33% of traffic) |
|
||||
| US-3261 | 94132 | 2477 (3% of traffic) |
|
||||
| US-3145 | 177663 | 29336 (16% of traffic) |
|
||||
| US-3180 | 269794 | 40409 (15% of traffic) |
|
||||
| US-3180 (16 Dec 11) | 289318 | 91964 (32% of traffic) |
|
||||
| TOTAL | 3257738 | 712366 (22% of traffic) |
|
||||
|
||||
| Provider | Collected | Attributed | Attributed% |
|
||||
| :------- | :-------- | :--------- | :---------- |
|
||||
| Yahoo | 444743 | 11009 | 2.48% |
|
||||
| Hotmail | 105068 | 1115 | 1.06% |
|
||||
| Gmail | 33697 | 2350 | 6.97% |
|
||||
| Facebook | 82857 | 79437 | 95.87% |
|
||||
| Other | 22881 | 1175 | 5.14% |
|
||||
| TOTAL | 689246 | 95086 | 13.80% |
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
## Serendipity – New Protocols
|
||||
|
||||
```
|
||||
(. .œ.......õ...
|
||||
].0.‚.. [REDACTED]@hotmMJðî0. What was your first phone numberÚ..[REDACTED]ú..
|
||||
|
||||
].Êú’¼.˜..„.. ..ˆ.. ..–ÿ’¼...6 .à‰ÖÁ...K .¼ËÄ... .ϬæÅ...7˜.βÄÍ...ž. .¼ð¸Õ.
|
||||
X.. .ÍÍÃý...«!-.¼âþ .ðB" ..Ó.Ø..â..[REDACTED]ê..BDò..ø.žãåÔ°%Ô.ÐÍîß°¢èîö§â¢ð.
|
||||
!..X@÷áی۱.HÀÉö™©Í¢...
|
||||
```
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
## Serendipity – HTTP Demux
|
||||
|
||||
```
|
||||
**eoc2c
|
||||
|
||||
GUOX1HdS/4k8YWAcliiPGd/Nvri0vYalboluzcaFdZcyfpHeg9rFTIytsjXoUyZnngI417JMAJHZ9M9ZXYwZU9qxvBWOLKZGBYlsvC43iUBvCrf4elcP2Pxs35+L
|
||||
Cache-Control: no-cache
|
||||
|
||||
POST /gateway/gateway.dll?Action=poll&Lifespan=60&SessionID=868216649.1709645966 HTTP/1.1
|
||||
Host: baymsg1030124.gateway.messenger.live.com
|
||||
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:14.0) Gecko/20100101 Firefox/14.0.1
|
||||
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,\*/*;q=0.8
|
||||
Accept-Language: en-us,en;q=0.5
|
||||
Accept-Encoding: gzip, deflate
|
||||
Connection: keep-alive
|
||||
X-Requested-Session-Content-Type: text/html
|
||||
Content-Type: text/html; charset=utf-8
|
||||
Pragma: No-Cache, no-cache
|
||||
X-MSN-Auth: Use-Cookie
|
||||
Referer: http://baymsg1030124.gateway.messenger.live.com/xmlProxy.htm?vn=9.090515.0&domain=live.com
|
||||
Content-Length: 0
|
||||
Cookie: wlidperf-latency=14338&throughput=0; mkt0=en-AF; wla42=cHJveHktYmF5LnB2dC1jb250YWN0cy5tc24uY29tfGJ5MS0xLDgzMTYzNjI1N
|
||||
Cache-Control: no-cache
|
||||
|
||||
NENE
|
||||
|
||||
**eotxt
|
||||
|
||||
POST in middle of session
|
||||
```
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
|
@ -0,0 +1,81 @@
|
|||
{
|
||||
"title": "Bulk collection of webmail address books and emerging protocols",
|
||||
"type": "REPORTED",
|
||||
"description": "TOP SECRET NSA document details the large-scale collection of email address books and contact lists from major webmail and social media providers, emphasizing their metadata value despite low attribution rates to known targets. It also highlights ongoing efforts to identify and analyze emerging communication protocols, such as those used by Hotmail Messenger.",
|
||||
"long_description": "This is a TOP SECRET//SI//NOFORN NSA Special Source Operations presentation excerpt covering two topics: bulk address book collection statistics across major webmail providers, and two \"serendipity\" protocol examples showing data from a new protocol and HTTP session data.\n\nThe address book section documents SSO's bulk collection of email address books from major webmail providers as of January 2012. Address books are described as collected as stand-alone sessions containing no content — meaning they are pure metadata — but are described as \"repetitive, large, and metadata-rich\" and stored redundantly across MARINA, MAINWAY, PINWALE and CLOUDS. The document notes a significant trend: address books had grown from approximately 12% of SSO's major accesses in August 2011 to 22% by January 2012, representing an increasing proportion of bulk collection volume.\n\nFive SIGADs are listed with session counts and address book volumes. US-3171 generated 1,488,453 total sessions with 237,067 address books representing 16% of traffic. DS-200B — MUSCULAR, the joint NSA/GCHQ programme tapping the private fibre links between Google's and Yahoo's data centres outside the US, as The Washington Post reported — generated 938,378 sessions with 311,113 address books representing 33% of traffic, the highest address book proportion of any SIGAD. US-3261 generated 94,132 sessions with only 2,477 address books, a low 3% rate. US-3145 generated 177,663 sessions with 29,336 address books at 16%. US-3180 generated 269,794 sessions with 40,409 address books at 15%.\n\nThe attribution table reveals a striking asymmetry across providers. Of 689,246 total address book sessions collected across all five SIGADs, only 95,086 — 13.8% — could be attributed to known users or targets. Facebook showed by far the highest attribution rate at 95.87%, reflecting Facebook's strong identity binding between accounts and real identities. Hotmail showed the lowest attribution at 1.06% — 98.94% of the Hotmail address books collected could not be attributed to known users or targets. Yahoo was 2.48% attributed, Gmail 6.97%. In all, 86.2% of the 689,246 address books in the attribution table could not be attributed to known users or targets.\n\nThe serendipity section illustrates a separate concept — the incidental collection of unexpected protocol data during bulk internet collection. The first example shows binary data from what appears to be an encrypted authentication exchange including a security question (\"What was your first phone number\") from a Hotmail account, captured as a byproduct of collection. The second example shows a raw HTTP session from Windows Live Messenger (MSN) gateway traffic — a POST request to baymsg1030124.gateway.messenger.live.com with session polling parameters, user agent, cookie data and MSN authentication headers — demonstrating that bulk collection was capturing instant messenger session traffic in addition to email. The term \"serendipity\" in this context refers to the discovery of previously unrecognised collection opportunities — new protocol types or data formats found unexpectedly within existing bulk collection streams that could be exploited for additional intelligence value.\n\nThe document demonstrates that the overwhelming majority of bulk address book collection — about 594,000 of the 689,246 address books in the attribution table — came from people with no established intelligence connection, collected solely because their email address appeared in a target's or non-target's contact list. It also shows NSA actively mining bulk collection for previously unidentified protocol types.",
|
||||
"tags": [
|
||||
"Yahoo",
|
||||
"Hotmail",
|
||||
"Gmail",
|
||||
"Facebook",
|
||||
"address books",
|
||||
"metadata",
|
||||
"attribution",
|
||||
"bulk collection",
|
||||
"serendipity",
|
||||
"Windows Live Messenger",
|
||||
"MSN",
|
||||
"HTTP",
|
||||
"SIGAD",
|
||||
"content acquisition",
|
||||
"incidental collection",
|
||||
"webmail",
|
||||
"email addresses",
|
||||
"emails",
|
||||
"contact book",
|
||||
"contact lists",
|
||||
"social media",
|
||||
"SSO",
|
||||
"targeting"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "",
|
||||
"classification": [
|
||||
"TOP SECRET",
|
||||
"SI"
|
||||
],
|
||||
"dissemination": [
|
||||
"NOFORN"
|
||||
],
|
||||
"banner": "TOP SECRET//SI//NOFORN",
|
||||
"genre": "slides",
|
||||
"programs": [
|
||||
"MARINA",
|
||||
"MAINWAY",
|
||||
"PINWALE",
|
||||
"CLOUDs",
|
||||
"Serendipity",
|
||||
"MUSCULAR",
|
||||
"SSO"
|
||||
],
|
||||
"countries": [],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Washington Post",
|
||||
"date_published": "2013-11-26",
|
||||
"title": "Microsoft, suspecting NSA spying, to ramp up efforts to encrypt its Internet traffic",
|
||||
"link": "https://www.washingtonpost.com/business/technology/microsoft-suspecting-nsa-spying-to-ramp-up-efforts-to-encrypt-its-internet-traffic/2013/11/26/44236b48-56a9-11e3-8304-caf30787c0a9_story.html",
|
||||
"reporters": [
|
||||
"Timberg, Craig",
|
||||
"Gellman, Barton",
|
||||
"Soltani, Ashkan"
|
||||
],
|
||||
"contributors": [],
|
||||
"doc_source": "http://apps.washingtonpost.com/g/page/world/hints-of-microsofts-vulnerability/621/",
|
||||
"doc_url": "https://s3.documentcloud.org/documents/841654/microsoft-in-cloud-exploitation-redacted.pdf"
|
||||
}
|
||||
],
|
||||
"aka_id": [
|
||||
{
|
||||
"id": "ACLU_-_address-book-wapo"
|
||||
},
|
||||
{
|
||||
"id": "nsa-microsoft-cloud-exploit"
|
||||
}
|
||||
],
|
||||
"pdf_sha256": "508b01ff2f5230c6ad2389e87d99548b5edfcce976ce390d824a3a6819528b6e",
|
||||
"pages": 3
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue