first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
|
|
@ -0,0 +1,248 @@
|
|||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Special Source Operations
|
||||
|
||||
# SSO Collection Optimization
|
||||
|
||||
Core SSO Team:
|
||||
[REDACTED]
|
||||
[REDACTED]
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Address Books
|
||||
|
||||
* Email address books for most major webmail are collected as stand-alone sessions (no content present\*)
|
||||
* Address books are repetitive, large, and metadata-rich
|
||||
* Data is stored multiple times (MARINA/MAINWAY, PINWALE, CLOUDS)
|
||||
* Fewer and fewer address books attributable to users, targets
|
||||
* Address books account for ~ 22% of SSO's major accesses (up from ~ 12% in August)
|
||||
|
||||
| Access (10 Jan 12) | Total Sessions | Address Books |
|
||||
| :----------------- | :------------- | :------------------- |
|
||||
| US-3171 | 1488453 | 237067 (16% of traffic) |
|
||||
| DS-200B | 938378 | 311113 (33% of traffic) |
|
||||
| US-3261 | 94132 | 2477 (3% of traffic) |
|
||||
| US-3145 | 177663 | 29336 (16% of traffic) |
|
||||
| US-3180 | 269794 | 40409 (15% of traffic) |
|
||||
| US-3180 (16 Dec 11) | 289318 | 91964 (32% of traffic) |
|
||||
| TOTAL | 3257738 | 712366 (22% of traffic) |
|
||||
|
||||
|
||||
| Provider | Collected | Attributed | Attributed% |
|
||||
| :-------- | :-------- | :--------- | :---------- |
|
||||
| Yahoo | 444743 | 11009 | 2.48% |
|
||||
| Hotmail | 105068 | 1115 | 1.06% |
|
||||
| Gmail | 33697 | 2350 | 6.97% |
|
||||
| Facebook | 82857 | 79437 | 95.87% |
|
||||
| Other | 22881 | 1175 | 5.14% |
|
||||
| TOTAL | 689246 | 95086 | 13.80% |
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Address Books
|
||||
|
||||
* Enabled in SCISSORS for various SSO sites:
|
||||
* JPMQ (metadata: QMPJ) - DS-200B (MUSCULAR) 29 Feb 2012
|
||||
* DGOT (metadata: TOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
|
||||
* DGOD (metadata: DOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
|
||||
* SPNN (metadata: NNPS) - US-3180 (SPINNERET) 03 May 2012
|
||||
* EGLP (metadata: PLGE) - US-3145 (MOONLIGHTPATH) 08 May 2012
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Address Books
|
||||
|
||||
### (S//SI) Ownerless Address Books Blocked by SCISSORS (MB)
|
||||
|
||||
```
|
||||
140,000
|
||||
120,000
|
||||
100,000
|
||||
80,000
|
||||
60,000
|
||||
40,000
|
||||
20,000
|
||||
0
|
||||
3/1/2012
|
||||
3/6/2012
|
||||
3/11/2012
|
||||
3/16/2012
|
||||
3/22/2012
|
||||
3/27/2012
|
||||
4/1/2012
|
||||
4/6/2012
|
||||
4/11/2012
|
||||
4/16/2012
|
||||
4/21/2012
|
||||
4/26/2012
|
||||
5/1/2012
|
||||
5/6/2012
|
||||
5/11/2012
|
||||
5/16/2012
|
||||
5/21/2012
|
||||
5/26/2012
|
||||
5/31/2012
|
||||
6/5/2012
|
||||
6/10/2012
|
||||
6/15/2012
|
||||
6/20/2012
|
||||
6/25/2012
|
||||
6/30/2012
|
||||
7/5/2012
|
||||
7/10/2012
|
||||
7/15/2012
|
||||
7/20/2012
|
||||
7/25/2012
|
||||
7/30/2012
|
||||
|
||||
Total
|
||||
```
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Address Books
|
||||
|
||||
```
|
||||
40000
|
||||
35000
|
||||
30000
|
||||
25000
|
||||
20000
|
||||
15000
|
||||
10000
|
||||
5000
|
||||
0
|
||||
AUC-393
|
||||
AUC-395
|
||||
CAC-98CG
|
||||
DS-200A
|
||||
DS-200B
|
||||
DS-200X
|
||||
DS-300
|
||||
DS-410
|
||||
DS-800
|
||||
NZC-333
|
||||
UKC-125
|
||||
UKC-206D
|
||||
UKC-215
|
||||
UKC-302A
|
||||
UKJ-260D
|
||||
US-3101M
|
||||
US-3105
|
||||
US-3145
|
||||
7/1/2012
|
||||
7/2/2012
|
||||
7/3/2012
|
||||
7/4/2012
|
||||
7/5/2012
|
||||
7/6/2012
|
||||
7/7/2012
|
||||
7/8/2012
|
||||
7/9/2012
|
||||
7/10/2012
|
||||
7/11/2012
|
||||
7/12/2012
|
||||
7/13/2012
|
||||
7/14/2012
|
||||
7/15/2012
|
||||
7/16/2012
|
||||
7/17/2012
|
||||
7/18/2012
|
||||
7/19/2012
|
||||
7/20/2012
|
||||
7/21/2012
|
||||
7/22/2012
|
||||
7/23/2012
|
||||
7/24/2012
|
||||
7/25/2012
|
||||
7/26/2012
|
||||
7/27/2012
|
||||
7/28/2012
|
||||
7/29/2012
|
||||
7/30/2012
|
||||
7/31/2012
|
||||
8/1/2012
|
||||
8/2/2012
|
||||
8/3/2012
|
||||
8/4/2012
|
||||
8/5/2012
|
||||
8/6/2012
|
||||
8/7/2012
|
||||
8/8/2012
|
||||
(blank)
|
||||
```
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## Selector Detasks
|
||||
|
||||
### Emergency Detasks
|
||||
|
||||
```
|
||||
140
|
||||
120
|
||||
100
|
||||
80
|
||||
60
|
||||
40
|
||||
20
|
||||
0
|
||||
Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12
|
||||
```
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
---
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
||||
SPECIAL SOURCE OPERATIONS
|
||||
|
||||
## So What?
|
||||
|
||||
* Store less of the wrong data
|
||||
* 20% reduction (so far) in content to long-term repositories
|
||||
* Data still resides at site for SIGDEV
|
||||
* Increase data variety
|
||||
* Hole left by "wrong data" filled with more "right data"
|
||||
* More signals and case notations can be tasked at site
|
||||
* Shifting collection philosophy at NSA
|
||||
* "Memorialize what you need” versus “Order one of everything off the menu and eat what you want"
|
||||
|
||||
WIKI: https://wiki.nsa.ic.gov/wiki/Collection_Optimization
|
||||
XKEYSCORE: fingerprint/defeats/atrouter and fingerprint/defeats/atxks
|
||||
|
||||
TOP SECRET//SI//NOFORN
|
||||
|
|
@ -0,0 +1,112 @@
|
|||
{
|
||||
"title": "SSO Collection Optimization",
|
||||
"type": "REPORTED",
|
||||
"description": "This is another presentation on problems with the National Security Agency's overcollection of address books and buddy lists and its efforts to weed out useless content. See also EFF_-_20131104-wapo-optimization_google",
|
||||
"long_description": "",
|
||||
"tags": [
|
||||
"SSO",
|
||||
"SSO Collection Optimization",
|
||||
"address books",
|
||||
"buddy lists",
|
||||
"metadata",
|
||||
"overcollection",
|
||||
"data reduction",
|
||||
"collection optimization",
|
||||
"Yahoo",
|
||||
"Hotmail",
|
||||
"Gmail",
|
||||
"Facebook",
|
||||
"Microsoft",
|
||||
"Google",
|
||||
"JPMQ",
|
||||
"DGOT",
|
||||
"DGOD",
|
||||
"SPNN",
|
||||
"EGLP",
|
||||
"QMPJ",
|
||||
"TOGD",
|
||||
"DOGD",
|
||||
"NNPS",
|
||||
"PLGE",
|
||||
"Site Codes",
|
||||
"AUC-393",
|
||||
"AUC-395",
|
||||
"CAC-98CG",
|
||||
"DS-200A",
|
||||
"DS-200B",
|
||||
"DS-200X",
|
||||
"DS-300",
|
||||
"DS-410",
|
||||
"DS-800",
|
||||
"NZC-333",
|
||||
"UKC-125",
|
||||
"UKC-206D",
|
||||
"UKC-215",
|
||||
"UKC-302A",
|
||||
"UKJ-260D",
|
||||
"US-3101M",
|
||||
"US-3105",
|
||||
"US-3145",
|
||||
"data storage",
|
||||
"repetitive data",
|
||||
"SSO Major Accesses",
|
||||
"traffic analysis",
|
||||
"emergency detasks",
|
||||
"internal wiki",
|
||||
"emails",
|
||||
"webmail",
|
||||
"fingerprints"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "",
|
||||
"classification": [
|
||||
"TOP SECRET",
|
||||
"SI"
|
||||
],
|
||||
"dissemination": [
|
||||
"NOFORN"
|
||||
],
|
||||
"banner": "TOP SECRET//SI//NOFORN",
|
||||
"genre": "slides",
|
||||
"programs": [
|
||||
"MARINA",
|
||||
"MAINWAY",
|
||||
"PINWALE",
|
||||
"CLOUD",
|
||||
"SCISSORS",
|
||||
"MUSCULAR",
|
||||
"DANCINGOASIS",
|
||||
"SPINNERET",
|
||||
"MOONLIGHTPATH",
|
||||
"SSO",
|
||||
"XKEYSCORE",
|
||||
"CLOUDS"
|
||||
],
|
||||
"countries": [],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Washington Post",
|
||||
"date_published": "2013-10-14",
|
||||
"title": "NSA collects millions of e-mail address books globally",
|
||||
"link": "https://www.washingtonpost.com/world/national-security/nsa-collects-millions-of-e-mail-address-books-globally/2013/10/14/8e58b5be-34f9-11e3-80c6-7e6dd8d22d8f_story.html",
|
||||
"reporters": [
|
||||
"Gellman, Barton",
|
||||
"Soltani, Ashkan"
|
||||
],
|
||||
"contributors": []
|
||||
}
|
||||
],
|
||||
"aka_id": [
|
||||
{
|
||||
"id": "nsa-scissors-2"
|
||||
},
|
||||
{
|
||||
"id": "nsa-sso-slides"
|
||||
}
|
||||
],
|
||||
"pdf_sha256": "5a284ca9984f135405402d22c9730f0c1a5e6a90330a940d2f28f08f125737ea",
|
||||
"pages": 7
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue