snowchive-meta/data/spiegel_-_media-35548/metadata.json
2026-11-19 04:39:11 +02:00

78 lines
6.5 KiB
JSON

{
"title": "Crypt Discovery Joint Collaboration Activity 20 January 2011",
"type": "REPORTED",
"description": "A TOP SECRET NSA/GCHQ joint collaboration activity plan from January 2011 describing a research programme to understand and mitigate the threat that rising encryption adoption poses to target discovery and development — measuring encryption prevalence across SIGINT collection, assessing the impact on metadata-based targeting tradecraft, and developing new techniques for identifying targets behind encrypted traffic using a joint cloud environment fed by MUTANT BROTH, BEARDED PIGGY, KARMA POLICE, MEMORY HOLE, MARBLED GECKO, SOCIAL ANIMAL and ASDF metadata.",
"long_description": "This is a TOP SECRET NSA/GCHQ joint collaboration activity plan dated 20 January 2011, with activity owners from both NSA and GCHQ. The document describes a structured research programme addressing what both agencies identified as a growing threat to their internet exploitation capability: the spread of TLS/SSL and IPSec encryption making the metadata they rely on for target discovery and development progressively harder to access.\n\nThe plan is organised around four research workstreams. The first involves monitoring the prevalence of encrypted traffic across all SIGINT collection — measuring what percentage of all observed traffic is encrypted, what percentage of encrypted traffic is associated with known targets, which encryption technologies targets use, how usage breaks down across webmail, search, mapping, forums, instant messaging, social networks and banking, and what the trend lines look like over time. The second workstream assesses the specific threat to existing capabilities: which Target Detection Identifiers and presence metadata will be lost inside encrypted channels, what the impact is on target discovery and development tradecraft, and how cross-correlation and complex query capabilities are affected. The third workstream examines pairing rates — the ability to correlate encrypted sessions seen at one collection point with sessions seen at another, assessing what can be paired within and between access points, whether CA (cryptanalytic) services could handle the volumes involved, and how cloud analytics could improve pairing by looking across time. The fourth workstream researches new methods for maintaining effective target discovery tradecraft despite encryption — including developing new TDI-like identifiers that persist across sessions behind HTTPS, characterising IPSec sessions from ESP metadata analysis using duration, packet length and burstiness, and combining content with metadata for better session identification.\n\nAn additional workstream addresses the mobile internet context specifically — assessing how much more challenging target discovery is behind mobile gateways and whether mitigations developed for fixed internet apply.\n\nThe technical requirements section lists the data sources available in the Joint Collaboration cloud environment: MUTANT BROTH, BEARDED PIGGY, KARMA POLICE, MEMORY HOLE, MARBLED GECKO, SOCIAL ANIMAL and ASDF metadata, alongside selected content related to encryption or specific target sets, new metadata creation capability through XKEYSCORE or local processing, and a CA server internal to the JC environment. The document also references TICKETWINDOW sites as a named collection environment used for pairing correlation demonstrations.\n\nTaken together the document provides a candid internal assessment of how seriously NSA and GCHQ viewed the encryption problem in 2011 — not as a capability already defeated but as a research challenge requiring sustained joint investment, with the two agencies pooling metadata sources and cloud analytics infrastructure to develop new targeting tradecraft before rising encryption adoption made their existing methods obsolete.\n\nIn plain terms this is a joint NSA/GCHQ research project plan addressing a problem both agencies were worried about: as more and more internet traffic became encrypted, the identifying information they relied on to find and track targets was disappearing inside those encrypted connections. The document lays out a programme to measure how bad the problem was, figure out what intelligence they were losing, and develop new ways of identifying suspects even when the content of their communications was hidden. It is significant as a direct statement from both agencies that encryption was genuinely impeding their work — and that they were investing heavily in finding ways around it.",
"tags": [
"Joint Collaboration",
"encryption",
"target discovery",
"target development",
"TLS",
"SSL",
"IPSec",
"HTTP",
"VPNs",
"ESP metadata",
"pairing rates",
"mobile internet",
"mobile gateway"
],
"document": {
"creator": "NSA",
"date_created": "2011-01-20",
"classification": [
"TOP SECRET"
],
"dissemination": [],
"banner": "TOP SECRET",
"genre": "other",
"programs": [
"TICKETWINDOW",
"MUTANTBROTH",
"BEARDEDPIGGY",
"KARMAPOLICE",
"MEMORYHOLE",
"MARBLEDGECKO",
"SOCIALANIMAL",
"XKEYSCORE",
"ASDF"
],
"countries": [],
"people": []
},
"publication": [
{
"publisher": "Der Spiegel",
"date_published": "2014-12-28",
"title": "Prying Eyes: Inside the NSA's War on Internet Security",
"link": "https://www.spiegel.de/international/germany/inside-the-nsa-s-war-on-internet-security-a-1010361.html",
"reporters": [
"Appelbaum, Jacob",
"Gibson, Aaron",
"Grothoff, Christian",
"Müller-Maguhn, Andy",
"Poitras, Laura",
"Sontheimer, Michael",
"Stöcker, Christian"
],
"contributors": [],
"doc_url": "https://cdn.prod.www.spiegel.de/media/56de51ca-0001-0014-0000-000000035548/media-35548.pdf"
},
{
"publisher": "The Intercept",
"date_published": "2015-09-25",
"title": "Profiled: From Radio to Porn, British Spies Track Web Users' Online Identities",
"link": "https://theintercept.com/2015/09/25/gchq-radio-porn-spies-track-web-users-online-identities/",
"reporters": [
"Gallagher, Ryan"
],
"contributors": [],
"doc_source": "https://theintercept.com/document/2015/09/25/crypt-discovery-activity/",
"doc_url": "https://s3.documentcloud.org/documents/2432273/crypt-discovery-activity.pdf"
}
],
"aka_id": [],
"pdf_sha256": "ba76c51d66d616e36f2a15569ddfb4bf99dbae14d5751b09e6af4b7b68845cbe",
"pages": 3
}