snowchive-meta/data/xks-application-ids-brief/metadata.json
2026-11-19 04:39:11 +02:00

68 lines
4.6 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

{
"title": "X-KEYSCORE Application IDs",
"type": "REPORTED",
"description": "A TOP SECRET XKeyscore developer training presentation teaching how to write the pattern-matching rules that automatically classify every intercepted internet session by application type, with working examples for Gmail detection, Yahoo chat, ICQ, VoIP protocols and a Mujahideen Secrets encryption fingerprint, plus a side-by-side comparison showing the migration from legacy XML-based pattern definitions to the modern C-like AppID syntax.\n",
"long_description": "This is a TOP SECRET//COMINT//ORCON//REL TO USA, FVEY XKeyscore Application IDs training presentation from the xkeyscore@nsa development team. It covers substantially the same material as the companion \"AppIDs & Fingerprints\" presentation but appears to be an earlier or parallel version, distinguished by its ORCON (Originator Controlled) marking and several content differences.\n\nThe core syntax, naming conventions, levels system, Boolean/regex/binary patterns, chainwords, built-in functions and predefined chainwords are identical to the companion document. The key differences are in the examples and the absence of the advanced C++ code-based AppID, microplugin and context-sensitive scanning sections that appear in the later version — suggesting this presentation predates those capabilities or was targeted at a less technical audience.\n\nThe most notable unique content is the Gmail detection chainword ($gmail), which reveals the specific strings XKeyscore uses to identify Gmail traffic: JavaScript function calls from Gmail's interface, POST/GET requests to /gmail paths, cookie patterns including SID cookies with specific character lengths on the .google.com domain, Gmail-specific cookies (GMAIL_AT, GMAIL_STAT, GMAIL_RTT, GMAIL_LOGIN), HTML title tags containing \"Gmail\" and the Google Front End server header (Server: GFE/). This provides a concrete example of how XKeyscore fingerprints a major webmail provider by matching against dozens of internal application-specific strings that ordinary users would never see.\n\nThe Mujahideen Secrets fingerprint appears in a slightly different form from the companion document — fingerprint('encryption/moujahedeen') matching \"begin+gimf+asrar+el+moujahedeen\" or \"begin gimf asrar el moujahedeen\" — representing the GIMF (Global Islamic Media Front) Asrar al-Mujahideen encryption tool header in both URL-encoded and plaintext forms.\n\nThe final slide shows a legacy XML-based pattern definition for IRC chat detection alongside its equivalent modern AppID syntax, demonstrating XKeyscore's evolution from a verbose XML configuration format to the streamlined C-like language. The XML format used keyword (KW) entries with positional constraints (POS=C for line-beginning matching equivalent to the modern first() function) and explicit select/deselect blocks, while the modern syntax expresses the same logic far more concisely using first() and Boolean operators. The AppID validation output confirms the same configuration file structure as the companion document — anonymizer.appid, bulletin_board.appid, tao_vpn.appid, tdmoip.appid, terminal.appid and voip.appid loaded from the dictionaries directory.",
"tags": [
"AppID",
"fingerprints",
"pattern matching",
"chainword",
"Gmail",
"Yahoo Messenger",
"ICQ",
"IRC",
"SIP",
"Skinny",
"SMTP",
"VoIP",
"IMS",
"Mujahideen Secrets",
"GIMF",
"Asrar al-Mujahideen",
"Google Front End",
"GFE",
"legacy XML",
"regex",
"vBulletin"
],
"document": {
"creator": "NSA",
"date_created": "",
"classification": [
"TOP SECRET",
"COMINT",
"ORCON"
],
"dissemination": [
"REL TO USA, FVEY"
],
"banner": "TOP SECRET//COMINT//ORCON//REL TO USA, FVEY//20291123",
"genre": "slides",
"programs": [
"XKEYSCORE",
"DECODEORDAIN"
],
"countries": [],
"people": []
},
"publication": [
{
"publisher": "The Intercept",
"date_published": "2015-07-01",
"title": "XKEYSCORE: NSA’s Google for the World’s Private Communications",
"link": "https://theintercept.com/2015/07/01/nsas-google-worlds-private-communications/",
"reporters": [
"Marquis-Boire, Morgan",
"Greenwald, Glenn",
"Lee, Micah"
],
"contributors": [],
"doc_source": "https://theintercept.com/document/2015/07/01/xks-application-ids-brief/",
"doc_url": "https://s3.documentcloud.org/documents/2116316/xks-application-ids-brief.pdf"
}
],
"aka_id": [],
"pdf_sha256": "734330b44f5311dc59fb0ff84fb51013e7adc597ca383e17ab1ef0bd6154935f",
"pages": 21
}