first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
112
data/xks-search-forms/metadata.json
Normal file
112
data/xks-search-forms/metadata.json
Normal file
|
|
@ -0,0 +1,112 @@
|
|||
{
|
||||
"title": "XKEYSCORE Search Forms",
|
||||
"type": "REPORTED",
|
||||
"description": "A secret XKeyscore reference guide from March 2009 cataloguing all of the system's search forms — one entry per metadata plug-in — revealing the full breadth of what XKeyscore extracts and indexes from intercepted internet traffic, from emails, logins, passwords, phone numbers and documents to Cisco router passwords, TOR routers, VoIP calls, WLAN data, Blackberry PINs, satellite terminals, passport images, internet café addresses, and exfiltrated data from TAO hacking operations.",
|
||||
"long_description": "This is a SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL XKeyscore reference guide dated March 2009. It systematically documents every search form available in XKeyscore, with each corresponding to a metadata plug-in that extracts and indexes a particular type of data from intercepted sessions.\n\nThe guide opens with query syntax — wildcards, Boolean operators, comparison operators, regular expressions, and Google-like full-text search with required/excluded terms and exact phrases. It then documents each search form. The core logging plug-ins include Full Log DNI (one record per session with SIGAD, casenotation, session UUID, MAC/IP addresses, ports and full application ID), Email Addresses (username, domain, subject), Logins & Passwords (anything resembling credentials, with examples showing captured HTML form fields and FTP logins), and Phone Numbers (parsed from signature blocks and address books).\n\nThe dictionary scanning plug-ins include Alert (log of sessions tipped to TRAFFICTHIEF, including the DECODEORDAIN permutation that triggered the tip and a copy of the XML sent to TRAFFICTHIEF) and Category DNI (category hits from CADENCE and other dictionaries). User Activity indexes webmail, chat and webcam activity with strong selectors — the worked example shows how a Yahoo user's session exposes machine-specific cookies (yahooBcookie, yahooGSS), proxy information and X-Forwarded-For IPs, and how these cookies can be correlated back to the username.\n\nThe document processing plug-ins include Extracted Files, Document Tagging (also called Tech Strings — labelling document and email bodies with second-level dictionary hits categorised as government, monetary, proliferation, satellite, wireless, etc.), Document Metadata (author, organisation, language, unique ID, timestamps, and hashes of the entire document and any embedded images), and PDF Metadata.\n\nThe protocol processing plug-ins are extensive and reveal the breadth of XKeyscore's collection: Blackberry (source/destination PIN and BES, payload type), Cellular DNI (IMSI, TMSI, IMEI, cell ID, latitude/longitude, spotbeam), Cisco Passwords (logged and decoded using the known weak obfuscation key), HTTP Activity (host, URL, parsed search terms from Google/Yahoo, user-agent, cookies, server type, geolocation from weather reports), IKE (Internet Key Exchange VPN parameters), IRC Café Geolocation (extracting café street addresses from IRC QUIT messages), Passport detection (OCR of passport images extracting name, passport number, issuing state, DOB — under development), Radius Logs (dial-up authentication), RBGAN and Cellular satellite terminal collection, RTP (VoIP audio/video decodable to playable media), SIP (VoIP call setup), SSL (certificate and encryption parameters), TOR Log (identified TOR routers), Web File Transfer (uploads/downloads from RapidShare, DepositFiles etc., under development by GCHQ/MHS), Web Proxy (X-Forwarded-For and leaked IPs from STUN and Google Earth), Wireshark (BGP, OSPF, VoIP, SMB, SNMP, GTP tunnelling), and WLAN (SSID, BSSID, MAC addresses).\n\nThe miscellaneous plug-ins include Call Logs (DNR telephony metadata from JUGGERNAUT, CERF, FASCIA and DURT), Network Logs (from MOONSHINE wireless collection), and two CNE-specific forms populated from TAO hacking operations — CNE (project name, collection technique, filename from TAO exfiltration) and Registry (Windows registry data including hive, key, subkey and value from compromised machines), both on the limited-deployment xks-cne cluster. The guide closes with Simple Search and Multi Search convenience forms that federate a single selector across multiple plug-in databases.\n\nThe document is significant as the definitive catalogue of XKeyscore's extraction capabilities, demonstrating that the system indexed not merely emails and web traffic but an extraordinary range of data types — router passwords, VPN handshake parameters, SSL certificates, TOR nodes, satellite terminal locations, Blackberry PINs, WLAN identifiers, passport images, internet café street addresses, telephony metadata from named DNR databases, and the exfiltrated contents of TAO-compromised machines. The inclusion of Cisco password decoding, IKE/SSL cryptographic parameter capture and CNE/Registry data shows XKeyscore serving simultaneously as a passive collection index, a cryptanalytic support tool and a repository for offensive hacking output. Several plug-ins credited to GCHQ/MHS and populated from MOONSHINE confirm the system's Five Eyes-wide development and deployment.",
|
||||
"tags": [
|
||||
"metadata",
|
||||
"email addresses",
|
||||
"phone numbers",
|
||||
"user activity",
|
||||
"extracted files",
|
||||
"embedded images",
|
||||
"BlackBerry",
|
||||
"Cellular DNI",
|
||||
"IMSI",
|
||||
"IMEI",
|
||||
"Cisco",
|
||||
"HTTP Activity",
|
||||
"IKE",
|
||||
"IRC Cafe Geolocation",
|
||||
"passports",
|
||||
"Tor",
|
||||
"Web File Transfer",
|
||||
"RapidShare",
|
||||
"Google Earth",
|
||||
"WiFi",
|
||||
"call logs",
|
||||
"Computer Network Exploitation",
|
||||
"Tailored Access Operations",
|
||||
"VoIP",
|
||||
"geolocation",
|
||||
"MHS"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "2009-03",
|
||||
"classification": [
|
||||
"SECRET",
|
||||
"COMINT"
|
||||
],
|
||||
"dissemination": [
|
||||
"REL TO USA, AUS, CAN, GBR"
|
||||
],
|
||||
"banner": "SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL",
|
||||
"genre": "slides",
|
||||
"programs": [
|
||||
"XKEYSCORE",
|
||||
"TRAFFICTHIEF",
|
||||
"DECODEORDAIN",
|
||||
"CADENCE",
|
||||
"JUGGERNAUT",
|
||||
"FASCIA",
|
||||
"CERF",
|
||||
"DURT",
|
||||
"MOONSHINE",
|
||||
"SPOTBEAM",
|
||||
"RADIUS"
|
||||
],
|
||||
"countries": [],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Intercept",
|
||||
"date_published": "2015-07-01",
|
||||
"title": "XKEYSCORE: NSA’s Google for the World’s Private Communications",
|
||||
"link": "https://theintercept.com/2015/07/01/nsas-google-worlds-private-communications/",
|
||||
"reporters": [
|
||||
"Marquis-Boire, Morgan",
|
||||
"Greenwald, Glenn",
|
||||
"Lee, Micah"
|
||||
],
|
||||
"contributors": [],
|
||||
"doc_source": "https://theintercept.com/document/2015/07/01/xks-search-forms/",
|
||||
"doc_url": "https://s3.documentcloud.org/documents/2116401/xks-search-forms.pdf"
|
||||
},
|
||||
{
|
||||
"publisher": "SVT Nyheter",
|
||||
"date_published": "2013-12-11",
|
||||
"title": "FRA has access to controversial surveillance system",
|
||||
"link": "https://www.svt.se/nyheter/granskning/ug/fra-has-access-to-controversial-surveillance-system",
|
||||
"reporters": [
|
||||
"Bergman, Sven",
|
||||
"Dyfvermark, Joachim",
|
||||
"Gallagher, Ryan",
|
||||
"Greenwald, Glenn",
|
||||
"Laurin, Fredrik",
|
||||
"Struwe, Filip"
|
||||
],
|
||||
"contributors": [],
|
||||
"doc_source": "http://www.svt.se/ug/read-the-snowden-documents-from-the-nsa",
|
||||
"doc_url": "https://www.documentcloud.org/documents/894406-nsa-slides-xkeyscore/",
|
||||
"version": "nsa-slides-xkeyscore",
|
||||
"note": "SVT Nyheter published a single slide from this deck — \"TOR Log\", page 37 of 49 — on 11 December 2013, a year and a half before The Intercept released the deck itself on 1 July 2015. The slide appeared inside a three-slide PDF accompanying SVT's reporting on NSA's cooperation with Sweden's FRA; the other two slides in that PDF are from X-KEYSCORE as a SIGDEV tool (xks-as-a-sigdev-tool)."
|
||||
}
|
||||
],
|
||||
"aka_id": [
|
||||
{
|
||||
"id": "nsa-slides-xkeyscore"
|
||||
},
|
||||
{
|
||||
"id": "EFF_-_20131211-svt-nsa_slides_xkeyscore"
|
||||
}
|
||||
],
|
||||
"pdf_sha256": "1ced284b2f47df5f962a2a8888b154aa5ca4ad09cdbf614ddf699006ad2b4a60",
|
||||
"pages": 49,
|
||||
"versions": {
|
||||
"nsa-slides-xkeyscore": {
|
||||
"pdf_sha256": "05397b912612a684f937469e66c5a8290b58aa3569b8a2adea2e3a74f36236ff"
|
||||
}
|
||||
}
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue