snowchive-meta/data/rwc-updater-readme/metadata.json
2026-11-19 04:39:11 +02:00

71 lines
4.5 KiB
JSON
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

{
"title": "RWC Updater Readme",
"type": "REPORTED",
"description": "A technical NSA manual describing the Royale with Cheese (RwC) Updater — the distribution system used to push XKEYSCORE dictionary updates, fingerprints, VoIP rules, IP geolocation tables and other configuration packages across the global hierarchical network of XKEYSCORE nodes on an hourly basis.\n",
"long_description": "This is the administrator guide and readme for the Royale with Cheese Updater (RwC), the software distribution system used to keep XKEYSCORE's global network of collection nodes synchronised with the latest targeting dictionaries, application identifiers, fingerprints and configuration files. The document is classified SECRET//REL TO USA, AUS, CAN, GBR, NZL, indicating it was shared across the full Five Eyes partnership, and describes a system that as of 2012 was distributing updates to over 700 XKEYSCORE servers at approximately 150 field sites worldwide.\n\nThe Royale with Cheese system operates on a hierarchical publisher-subscriber model, with a central control node distributing updates downward through master and proxy nodes to slave collection nodes, each checking in hourly. The update mechanism uses hash verification at each step to ensure integrity, with chunked downloads accommodating the bandwidth constraints of collection sites in remote locations — a practical detail revealing that some XKEYSCORE field sites operate on sufficiently slow connections that the default 5MB chunk size had to be made configurable. The system also handles version management for the XKEYSCORE software itself through a component called Starproc, managing the complexity of running different software versions across a large distributed infrastructure.\n\nThe package manifest accompanying the readme is particularly revealing about XKEYSCORE's capabilities and architecture. The full list of updateable components includes targeting dictionaries for specific application identifiers at multiple classification levels, VoIP normalisation rules from a system called FALLENORACLE, Snort intrusion detection rules, phone number extractors, obfuscation scanner rules, selector permutation scripts for platforms including YouTube, cadence dictionary rules, Traffic Thief alert files, IP geolocation tables drawn from the Network Knowledge Base updated daily in 23 hourly partials, vBulletin forum selector lists, virus scanner definitions, and geo-information files listing points of interest including cities, airports and embassies by latitude and longitude. The separation of application identifier packages by classification level — with distinct packages for non-COMINT, COMINT, SECRET REL, SECRET SI REL, TOP SECRET REL and TOP SECRET SI REL — reveals the fine-grained access control applied to different categories of targeting information across the Five Eyes partnership.",
"tags": [
"Royale with Cheese",
"RwC",
"XKS",
"dictionary updates",
"fingerprints",
"application identifiers",
"AppID",
"VoIP",
"IP geolocation",
"network knowledge",
"NKB",
"distributed infrastructure",
"surveillance architecture",
"collection sites",
"field sites",
"targeting dictionaries",
"selector development",
"obfuscation",
"cadence dictionaries",
"metadata forwarder",
"starproc"
],
"document": {
"creator": "NSA",
"date_created": "2012-09-10",
"classification": [
"SECRET"
],
"dissemination": [
"REL TO USA, AUS, CAN, GBR, NZL"
],
"banner": "SECRET//REL TO USA, AUS, CAN, GBR, NZL",
"genre": "manual",
"programs": [
"XKEYSCORE",
"CADENCE",
"FALLENORACLE",
"CORRELATION",
"SNORT",
"TRAFFICTHIEF",
"NKB",
"STARPROC"
],
"countries": [],
"people": []
},
"publication": [
{
"publisher": "The Intercept",
"date_published": "2015-07-01",
"title": "XKEYSCORE: NSA’s Google for the World’s Private Communications",
"link": "https://theintercept.com/2015/07/01/nsas-google-worlds-private-communications/",
"reporters": [
"Marquis-Boire, Morgan",
"Greenwald, Glenn",
"Lee, Micah"
],
"contributors": [],
"doc_source": "https://theintercept.com/document/2015/07/01/rwc-updater-readme/",
"doc_url": "https://s3.documentcloud.org/documents/2133063/rwc-updater-readme.pdf"
}
],
"pdf_sha256": "feb32ac9af2d3996f12e046fe26a4a5f607bc649b735a3e966abdad046ef42ba",
"pages": 13
}