first commit

This commit is contained in:
libroot 2026-11-19 04:39:11 +02:00
commit 0d90363116
Signed by: libroot
GPG key ID: 2AC68C029EBE9ACE
6510 changed files with 679146 additions and 0 deletions

View file

@ -0,0 +1,526 @@
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
XKEYSCORE
# Email Address vs User Activity
24 June 2009
Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20291123
DERIVED FROM: NSA/CSSM 1-52
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
08
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Email Addresses
* The Email Address search allows you to search on:
* Full Email Address
* Do not search on/wildcard JUST the username, always include a specific domain
* Foreign-hosted domains (e.g. @cnc.cn)
* The query searches within bodies of emails, webpages and documents for.... (you guessed it)...Email Addresses
* To, From, CC, BCC lines..
* "Contact Us" pages on websites
* Signature blocks
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Email Address
* Email Addresses are found in many parts of traffic
```
DNI Display Raw Data DNI Format
Subject: RE: Malaysia Tax
From: [REDACTED]
To: [REDACTED]
Cc: [REDACTED]
Date: Tue Jun 23 12:41:25 GMT 2009
Attachments: 01.jpg (12013 bytes);
XKEYSCORE has picked up traffic with email addresses in it..
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Email Address
```
DNI Display Raw Data DNI Format
Subject: RE: Malaysia Tax
From: [REDACTED]
To: [REDACTED]
Cc: [REDACTED]
Date: Tue Jun 23 12:41:25 GMT 2009
Attachments: image001.jpg (12013 bytes);
X-KEYSCORE C2C Session Viewer
Session 9 of 18
```
| Datetime | Case Notation | From IP | To IP | From Port | To Port | Protoco | Len |
| :------------------ | :-------------- | :----------------------------- | :------------------------ |
| 2009-06-23 12:41:28 | PRPA07550000000 | 198.[REDACTED] (United States) | 219.[REDACTED] (Malaysia) | 39247 | 25 | tcp | 486
Session | Header (3) | Attachments (5) | Meta (10)
attribute_info.txt email_addresses.txt tech.html application_id.xml appproc.asdf xks_snippet.txt phone_number.html fingerprints.xml user_activity.xml ip_lc_trie.txt
```
email_addresses.txt
Formatter AUTO
Using TXT formatter
[REDACTED]
[REDACTED]
[REDACTED]
[REDACTED]
XKEYSCORE parses out everything it 'thinks' is an email address, so don't be fooled by mis-hits
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Creating Email Address Queries
* Enter usernames and domains into query
```
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com
* Subject: [REDACTED]
Mulitiple usernames from SAME domain can be OR'd
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Creating Email Address Queries
* BE VERY CAREFUL of OR'ing domains
```
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2009
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com or hotmail.com
* Subject: [REDACTED]
When working with multiple domains, create separate Email Address queries for each. i.e. Group your queries by domain names.
Mulitiple domains means either badguy@yahoo.com or badguy@hotmail.com. Are both your targets?
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Email Address
* Sample Search: baku@huawei.com
```
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: azerbaijiani huawei bubba
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Week Start: 2009-06-17 00:00 Stop: St
* Email Username: baku
* @Domain: huawei.com
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Email Address
* Email Addresses are found in many parts of traffic
```
DNI Display | Raw Data | DNI Format
HTTP Header Information | Content Type: HTTP/HTML
Services
Fax: 0061-2-94118533
Vienna, Austria
Ezone Office Building, 4th Floor/ Top 7, Ernst-Melchior-Gasse 20, 1020 Vienna, Austria
Tel:
Baku, Azerbaijan
Caspian Plaza Centre, block 610-611, J.Jabbarly St., Baku
Azerbaijan, Az1065
Tel: 0099412-510-5644/5744/5844
Fax: 0099412-510-5944
E-mail: baku@huawei.com
Results here are from someone viewing a website that contained the email address
Building 647, Road 2811Seef District 428 Kingdom of Bahrain
Tel: 00973-17568708
Fax: 00973-17568701
Bahrain, Bahrain
Villa NO.1, Mohamedia Garden, Gate NO.36,Road
No.3431, Block No.334, Bahrain
Tel: 00974-3443296/00973-9580085
Dhaka, Bangladesh
R.M. Centere(2nd Floor),101, gulshan Avenue Gulshan Model
Town Dhaka 1213 Bangladesh
Minsk, Belarus
Korolya str., 51, floor-2, office-28, Minsk, Belarus
Tel: 00375-17-2048903
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## User Activity Query
* User Activity query is based on APPROC collection (such as chat, webmail, etc)
* Allows more flexible search criteria than Email Address query
* Can search on: Cookies, numeric logins (e.g. web forums & OSN), VoIP selectors, webcam first images, Webmail profile information from registration (birthdays), general usernames
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
KEYSCORE
## Creating User Activity Queries
* The fields in a User Activity query can be confusing
```
Datetime: Custom | Start: 2009-06-23 11:00 | Stop: 20
Search For:
Search Value:
Realm:
Attribute Type:
Attribute Value:
Activity:
Source:
IP Address:
Enter target selectors/identifiers here:
-Phone No
-Cookie
-Username/EMAD (then add REALM)
-
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Creating User Activity Queries
* The fields in a User Activity query can be confusing
| Search For | Search Value | Attribute Type | Attribute Value |
| :--------- | :---------------- | :------------- | :---------------------- |
| username | [REDACTED]@yahoo | communicants | saifdes ziad 197 |
| username | [REDACTED]@yahoo | contact_list | 0920273966 999999 a_salty a_t_love_me aa |
| username | [REDACTED]@yahoo | direction | server-to-client |
| username | [REDACTED]@yahoo | from | [REDACTED] |
| username | [REDACTED]@yahoo | previous_user | [REDACTED] |
| username | [REDACTED]@yahoo | raw_metadata | [REDACTED] |
| username | [REDACTED]@yahoo | to | [REDACTED] |
| username | [REDACTED]@yahoo | user_realm | emailAddr |
| username | [REDACTED]@yahoo | yahoo | [REDACTED] |
| username | [REDACTED] | emailAddr | [REDACTED]@yahoo |
| username | [REDACTED]@yahoo | app_provider | YMSG |
Notice partial email addresses in the "Search Value" field..
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Creating User Activity Queries
* Scenario:
* You have a target's email address:
* [REDACTED]@hotmail.com
* Known: One email address
* Unknown: Alternate ID's, IPs, Location, Photo, etc... (lots of stuff)
* Where do we begin?
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have an Email Address and want to see if it's being collected?
* Do an Email Address query on username and domain
Email Username: baku
@Domain: huawei.com
* Do a User Activity query on the email address in the "Selector Value"
Search Value: baku@huawei*
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have a Cookie and want to see what other accounts access this computer
* Do TWO separate User Activity query on the cookies
* 1. Attribute Value: dg8q0od4u0li4
* Brings back THESE results...
| Search For | Search Value | Attribute Type | Attribute Value |
| :--------- | :---------------- | :------------- | :-------------- |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | dg8q0od4u0li4 | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_coo | |
Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)
TOP SECRET//COMINT//RE
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have a Cookie and want to see what other accounts access this computer
* Do TWO separate User Activity query on the cookies
* 2. Search Value: dg8q0od4u0li4
* Brings back THESE results...
| Search For | Search Value | Attribute Type | Attribute Value |
| :--------- | :------------ | :------------- | :--------------- |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)
TOP SECRET//COMINT//RE
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have a Cookie and want to see what other accounts access this computer
* Do a Marina query on the cookie as well (why not)?
```
Specify Date Range (YYYYMMDD [hhmmss]): 20090614 to 20090620
<S Data
for User Activity by... Strong Selectors (Emads, IDs, Cookies, Mail Tokens, Phone
that... exactly match
the value(s)... dg8q0od4u0li4<yahoobcookie>
it is reached, return... newest data ? (100,000 raw metadata result limit)
where value is. active user?
in user_a or user_b column?
filter by... Add Field | Condition | Criteria
?
*Emiclunent Options: All None Select
Query Justification (optional): iranian b cookie in esfahan
Submit Reset Form Clear Form
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have a Cookie and want to see what other accounts access this computer
* Do a Marina query on the cookie as well (why not)?
| USER_A | ACTIVITY | USER_B | COOKIE |
| :---------------- | :------------------- | :-------------------------- | :-------------------------- |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* So let's put the cookie query all together...
* Between Marina and XKS, I should have an idea of all the accounts..
* Results pulling on dg8q0od4u0li4 as a Search Value
| Search For | Search Value | Attribute Type | Attribute Value |
| :--------- | :------------ | :------------- | :------------------------- |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | raw metadata | <commEventSummary> <appPro |
* Plus my Marina results
| USER_A | ACTIVITY | USER_B | COOKIE |
| :---------------- | :------------------- | :-------------------------- | :-------------------------- |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
RESULTS: Three users on the a computer..
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## I want to....
* I have an IP address and want to know what users/accounts are collected in that network? (I.E. a Café's IP address, or mail/web server for an organization)
* Do an Email Address query on the IP address
```
Email Username:
@Domain:
Subject:
IP Address: [REDACTED] From
```
* Do a User Activity query on the IP address
```
Search For:
Search Value:
Realm:
Attribute Type:
Attribute Value:
Activity:
Source:
IP Address: [REDACTED]
```
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
## Moral of the story
* Email Address query looks for the @ symbol in traffic
* User Activity search allows you to query on more than just an email address
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

View file

@ -0,0 +1,90 @@
{
"title": "Email Address vs User Activity",
"type": "REPORTED",
"description": "This 2009 NSA training presentation explains how to use the XKEYSCORE system to search raw SIGINT, detailing the differences between the \"Email Address\" query, which finds email addresses in full content, and the more flexible \"User Activity\" query, which can search for selectors like cookies, usernames, and phone numbers.",
"long_description": "This NSA document is an analyst training guide on how to use the XKEYSCORE surveillance system to query for information related to specific selectors. The presentation focuses on the distinction between two main query types: the \"Email Address\" query and the \"User Activity\" query. The Email Address query allows an analyst to search for full email addresses within the body of emails, documents, and webpages, but the guide warns that it can be imprecise, as it simply looks for strings containing the \"@\" symbol.\n\nThe \"User Activity\" query is presented as a more flexible and powerful option, as it is based on APPROC (application processing) collection and allows searching for a wider range of selectors beyond just email addresses. These include cookies, usernames for web forums, VoIP selectors, and phone numbers. The guide provides a detailed scenario on how an analyst can pivot from a single cookie, use both XKEYSCORE User Activity queries and queries in the MARINA metadata database, and successfully identify all user accounts that have been active on a specific computer.",
"tags": [
"training",
"analyst guide",
"email addresses",
"raw traffic",
"AppProc",
"selectors",
"target development",
"cookies",
"IP addresses",
"usernames",
"phone numbers",
"VoIP",
"webmail",
"chat",
"browsing history",
"full content analysis",
"metadata",
"strong selectors",
"Huawei"
],
"document": {
"creator": "NSA",
"date_created": "2009-06-24",
"classification": [
"TOP SECRET",
"COMINT"
],
"dissemination": [
"REL TO USA, AUS, CAN, GBR, NZL"
],
"banner": "TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123",
"genre": "slides",
"programs": [
"XKEYSCORE",
"MARINA",
"ASDF"
],
"countries": [
"Malaysia",
"Iran",
"Azerbaijan",
"Bahrain",
"Bangladesh",
"Austria",
"Belarus"
],
"people": []
},
"publication": [
{
"publisher": "The Intercept",
"date_published": "2015-07-01",
"title": "XKEYSCORE: NSA’s Google for the World’s Private Communications",
"link": "https://theintercept.com/2015/07/01/nsas-google-worlds-private-communications/",
"reporters": [
"Marquis-Boire, Morgan",
"Greenwald, Glenn",
"Lee, Micah"
],
"contributors": [],
"doc_source": "https://theintercept.com/document/2015/07/01/email-address-vs-user-activity/",
"doc_url": "https://s3.documentcloud.org/documents/2116020/email-address-vs-user-activity.pdf"
},
{
"publisher": "Metropolitan Books",
"date_published": "2014-05-13",
"title": "No Place to Hide",
"link": "https://www.glenngreenwald.net/#BookDocuments",
"reporters": [
"Greenwald, Glenn"
],
"contributors": [],
"version": "no-place-to-hide",
"note": "The pages reprinted in the document appendix of No Place to Hide (appendix page 75)."
}
],
"pdf_sha256": "be66657a58fd4206c22bb0b16047a231357f6f020a177f8969b4d46bf3e640c8",
"pages": 20,
"versions": {
"no-place-to-hide": {
"pdf_sha256": "7fecebf4014dcde822cd7572be9fcf7f926b11d5812dbcb5344f42fd3585dde5"
}
}
}

View file

@ -0,0 +1,24 @@
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
# Creating Email Address Queries
### Enter usernames and domains into query
**Search: Email Addresses**
| Field | Value |
|---|---|
| Query Name: | `kmkeith_2` |
| Justification: | `aqi in iran sample` |
| Additional Justification: | |
| Miranda Number: | |
| Datetime: | `1 Day` Start: `2009-06-23` `00:00` Stop: `2` |
| Email Username: | `badguy or baddudel or badguysemail` |
| @Domain: | `yahoo.com` |
| Subject: | |
Mulitiple usernames from SAME domain can be OR'd
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
---