{ "title": "SIGDEV Conference 2012 - Making Things Measureable: Technology Trending Challenges and Approaches", "type": "REPORTED", "description": "An NSA presentation from the 2012 SIGDEV Conference describing NSA's technology trending methodology — a framework for identifying which encryption and communications technologies targets are adopting, measuring the SIGINT risk they pose, and prioritising capabilities development responses — notable for containing the risk matrix that was later cited in Der Spiegel's December 2014 encryption investigation showing NSA's difficulty levels against specific technologies including Tor, TrueCrypt, OTR and ZRTP.", "long_description": "This is a TOP SECRET//COMINT//REL FVEY presentation from the 2012 SIGDEV Conference, published by Der Spiegel under the German title \"Präsentation von der SIGDEV Conference 2012 über die unterschiedlichen Schwierigkeitsgrade, die Verschlüsselungstechniken für die NSA darstellen\" (\"Presentation from the SIGDEV Conference 2012 on the different levels of difficulty that encryption techniques pose for the NSA\"). The document was produced by the CT Trends team and addresses the challenge of anticipating which communications technologies terrorist targets will adopt before those technologies become collection priorities.\n\nThe presentation frames the core problem as preventing strategic surprise: NSA's Counter-Terrorism analysts need to know both what technologies terrorist targets are currently using and which emerging technologies are likely to be adopted. The approach uses two analytical optics. Optic 1, Emerging Technology Discovery, focuses on the interest and experimentation phases of technology adoption — scanning technical thought leaders, extremist technical sub-forums via FORTREND, administrative emails, forum links and uploaded files for indicators of new technology interest. Optic 2, Technology Use Discovery, focuses on the adoption phase — using tools including XKEYSCORE, SEEKER, BIONICTURTLE, JEMA, JOLLYROGER, MARINA and TUNINGFORK alongside QFDs and cloud analytics to identify technology use patterns, trends and anomalies across user-agents, tasking, network protocols, visited URLs, process lists, hardware usage and other indicators.\n\nThe central analytical product is a Capabilities Development Risk Matrix mapping two dimensions: Use Risk (how widely adopted a technology is among CT targets, from Trivial to Catastrophic) against Impact on SIGINT production. The matrix populated with January-February 2012 examples is the document's most significant content. In the Catastrophic/highest priority cell sits \"Tor + Trilight Zone + Cspace + ZRTP VoIP client on Linux\" — described as causing near-total loss of insight. In the Major/highest priority cell sit OTR, Tor alone, Smartphones, Zoho.com webmail and TrueCrypt. In the Moderate cell sit Mail.ru, TeamViewer and Join.me. In the Minor/highest priority cell sit Fivewes and Facebook chat. The January-February 2012 examples table shows specific target associations: AQSL courier and GIMF using TAILS (Quadrant 1), AQ media using TrueCrypt (Quadrant 1), and an extremist version of Tor identified by a Technical Thought Leader as an Opportunity. This matrix is the source of the difficulty level classifications cited in Der Spiegel's December 2014 encryption article.\n\nThe solution framework maps each risk quadrant to a capabilities development response type. Trivial risks require only XKeyscore fingerprints. Minor risks need realm creation and simple extraction. Moderate risks require STARPROC capability, CES detectors, endpoint characterisation and correlation analytics. Major risks require focused inter-office capabilities development with a lead programme manager, SPF and 2p/3p working groups. Catastrophic risks require SID-level attention involving FAMT, LAE, WPMO and AMOD portfolio integration.\n\nThe document also describes the Emerging Technology Snapshot — a monthly 1-3 page product delivered to CT leadership alongside full data to MICROEXPANSE, supported by Data Explorer, ECHOBASE, and planned inclusion of FAA/PRISM in GM-Halo. Rising strategic issues identified in January-February 2012 include encrypted webmail services (Atabmail, Zoho, Safe-mail, Fastmail, HMA Mail), remote desktop tools (TeamViewer, Join.me, Cybergate) and over-the-top messaging services (WhatsApp, Nimbuzz, eBuddy).\n\nThe challenges section is candid about operational limitations: 19 branches, 30+ target sets, approximately 200 realms, 800 domains and 45,000 selectors generate approximately one million rows of data every 2.5 weeks from EO 12333 collection alone, exceeding Excel's capacity. Target Knowledge Base and UTT data quality problems from years of freeform data entry are acknowledged, with remediation not expected until approximately 2015.\n\nLAE (Large Access Exploitation) and AMOD appear in the solution framework but are identified from other published documents: LAE is the Large Access Exploitation Working Group focused on optimising SSO collection from large access points, and AMOD is an NSA analytic modernisation framework associated with the QFD Strategy and GAMBIT portal. WPMO is the Wireless Portfolio Program Office (S3W), the NSA division managing wireless collection strategy.", "tags": [ "technology trends", "risk matrix", "capabilities development", "strategic surprise", "Tor", "TrueCrypt", "OTR", "ZRTP", "Tails", "Cspace", "Trilight Zone", "TeamViewer", "Join.me", "WhatsApp", "Nimbuzz", "eBuddy", "Zoho", "Mail.ru", "Redphone", "Web.de", "encrypted webmail", "remote desktop", "over-the-top messaging", "AQSL", "GIMF", "Al-Qaeda", "Technical Thought Leader", "SIGDEV", "EO 12333", "FAA", "SPF" ], "document": { "creator": "NSA", "date_created": "2012-06-01", "classification": [ "TOP SECRET", "COMINT" ], "dissemination": [ "REL FVEY" ], "banner": "TOP SECRET//COMINT//REL FVEY//20340601", "genre": "slides", "programs": [ "XKEYSCORE", "SEEKER", "BIONICTURTLE", "JEMA", "JOLLYROGER", "MARINA", "TUNINGFORK", "STARPROC", "MICROEXPANSE", "ECHOBASE", "PRISM", "GMHALO", "UTT", "TKB", "LAE", "FAMT", "WPMO", "AMOD", "FORTREND", "GAMBIT", "DATAEXPLORER", "MYNOC" ], "countries": [ "Germany", "Russia" ], "people": [] }, "publication": [ { "publisher": "Der Spiegel", "date_published": "2014-12-28", "title": "Prying Eyes: Inside the NSA's War on Internet Security", "link": "https://www.spiegel.de/international/germany/inside-the-nsa-s-war-on-internet-security-a-1010361.html", "reporters": [ "Appelbaum, Jacob", "Gibson, Aaron", "Grothoff, Christian", "Müller-Maguhn, Andy", "Poitras, Laura", "Sontheimer, Michael", "Stöcker, Christian" ], "contributors": [], "doc_url": "https://cdn.prod.www.spiegel.de/media/672ebbb0-0001-0014-0000-000000035535/media-35535.pdf" } ], "pdf_sha256": "f84d0b64eb23f55d137963ce5e11c67862a15d621b490ec9c797acd4a8be2ddd", "pages": 40 }