KEYSCORE # X-KEYSCORE as a SIGDEV tool 2009 [REDACTED] --- What is X-KEYSCORE? --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## What is XKEYSCORE? A (DNI) SIGDEV Tool It gives you the ability to discover things that you otherwise wouldn't have seen TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## What makes XKS so good at SIGDEV? * XKS gives analysts unique access to terabytes of content and meta-data * Typically sites select and forward to PINWALE less than 5% of the DNI they're processing * The rest of that data used to be dropped but is now being retained temporarily and made available to analysts through X-KEYSCORE * As an example, at one our sites XKS sees more data per day than all of PINWALE TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## DNI Discovery Options ``` Meta-data from a subset of tasked strong-selectors Trafficthief Content selected from dictionary tasked terms Pinwale "User Activity" meta-data with front end full take feeds and back-end selected feeds MARINA Unique data beyond user activity from front end full take feeds XKeyscore Low High ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## "Slowing down the Internet" * XKS goal is to store the full-take content for 3-5 days, effectively "slowing down the Internet" so that analysts can go back and recover sessions that otherwise would have been dropped by the front end * Meta-data is saved off longer, with the goal of 30 days retention * A lot of analysis can be done through meta-data only (MARINA is meta-data only) TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS Storage Times * Front end storage is limited by resources and policy restrictions and will vary by site * At some sites, the amount of data we receive per day (20+ Terabytes) can only be stored for as little as 24 hours based on available resources * Other sites have legal or policy restrictions that limit the amount of time we can store data (if we can at all) * It's a rolling buffer where new data comes in and pushes the oldest data out TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## How can I "save off" XKS data? * Content that is "interesting" can be pulled out of X-KEYSCORE and pushed to Agility or PINWALE or any other database for longer retention * Workflows can be set up to automatically harvest content out of XKS before it ages off * The goal, however, is to use X-KEYSCORE to discover new things, that will end up on tasking for future collection TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## How do I access XKS data? * It's important to know that XKS queries meta-data tables only * Results from the meta-data tables are then linked back to the original piece of content * Goal of the system is to extract a wide range of meta-data for users to query TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## What kind of meta-data is produced? ``` Classic A-M * ASF and WMV Metadata * Alert * BlackBerry * CNE * Call Logs * Category DNI * Cellular DNI * Cisco Passwords * Document Metadata * Document Tagging * Email Addresses * Extracted Files * Full Log DNI * HTTP Activity * IRC Cafe Geolocation * Logins and Passwords ``` ``` Classic N-Z * Network Logs * PDF Metadata * PILBEAM * Phone Number Extractor * RBGAN * REGISTRY * RTP * Radius Logs * RealMedia Metadata * SIP * TOR Log * Tech Strings in Documents * User Activity * WLAN * Web Proxy * Wireshark ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Examples of "simple" Plug-ins | Plug-in | DESCRIPTION | | :---------------- | :---------- | | E-mail Addresses | Indexes every E-mail address seen in a session by both username and domain | | Extracted Files | Indexes every file seen in a session by both filename and extension | | Full Log | Indexes every DNI session collected. Data is indexed by the standard N-tupple (IP, Port, Casenotation etc.) | | HTTP Parser | Indexes the client-side HTTP traffic (examples to follow) | | Phone Number | Indexes every phone number seen in a session (e.g. address book entries or signature block) | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Examples of "advanced" Plug-ins | Plug-in | DESCRIPTION | | :------------------ | :---------- | | User Activity | Indexes the Webmail and Chat activity to include username, buddylist, machine specific cookies etc. (AppProc does the exploitation) | | Document meta-data | Extracts embedded properties of Microsoft Office and Adobe PDF files, such as Author, Organization, date created etc. | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Plug-ins * A single session may contain entries in multiple meta-data tables * For example, if a single session had a user E-mailing an attached word document the following plug-ins would extract meta-data: | Plug-in | Would have extracted... | | :----------------- | :---------------------- | | Full Log | ...bare minimum meta-data like To/From IP address, ports, casenotation, sigad etc. | | E-mail Addresses | ...any E-mail addresses seen on that page (including inside the attached word file) | | Extracted Files | ...the filename and extension of the attachment | | Document Meta-data | ...in addition to the filename and extension, any embedded properties of the word document like Author, last author, organization, date created, date last modified etc. | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE DEPLOYMENTS ``` 125 Sites ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE DEPLOYMENTS ``` 125 Sites ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## AppIds and Fingerprints * X-KEYSCORE produces an application id for each session processed * Currently almost 1300 Appids in 28 categories * An Appid is meant to identify a session as a particular application * Fingerprints are an extensible way of tagging sessions * Ex: A session Appid'd as mail/smtp might also contain fingerprints for encryption if used in the email TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## AppIds and Fingerprints Ex: E-Mails with encryption ``` From: "Launchpad OpenPGP Key Confirmation" [Save Address] [Block Sender] To: [REDACTED] Cc: Subject: Launchpad: Confirm your OpenPGP Key Date: Wed, 31 Dec 2008 10:04:16 -0000 -----BEGIN PGP MESSAGE----- Version: GnuPG v1.4.6 (GNU/Linu) Application AppID (+Fingerprints) mail/webmail/outblaze mail/webmail/outblaze has_fingerprint encryption/pgp encryption/pgp/message spflMVPZsI1vpg67VdHFUprgv0JpmjQlb73gWmhbOUrZzyGdDRIa9CcFzJA7OIL 3XyCrIniniJ4/c98+khDazh1XY/S7yNi38Wrlkd3GOz9DFFI1Nu31nwjh3+ncOpv OlyztsQzLFB/8+qJrPvmK8fzz7tWp2djxyfMGoAYNAf/QOohR0BjqTg0UlqLRVrE eEFivrMOnBx160SHIFra7LpZISTUFpBJNAkgguk7mBfJ0dMmU0V5MeM1x8GuW5+ Uk4bBwwZ1VpEVHCyGuv8ux+V+KpSkQtDwdhlp12SZ2SUm1upnVB9IfcnlhWvxZp LaY3mXqNWhyhzFPFxkhUwqzd/rMxrCJucfXGaeisSizZDIQOWxTSwe7BwwG8Bvnr QEQVKY30WWg+2pDTPrKq3uEqOwj9JY7KTPMr2gZLNABDUCJm5IRALZqqETTg4dh xV0r9+2ZLtyGDXQhLMyBEIYns4+jiP1rd3E+TW7JVUe/jPluyC4DwOUPklwuHcC+ StLAUQHMS6RkB4aDNdi6QG9kEWvjq2PvfuMIBWo5jJ8RFODSx8q5t1ukgeCxr8xr Q4eTmOFTIA71G312Xa7ZniOzyxiWZ4CAbhHLF+3baFD3lb4/EFmRvPBdqy6wUyHD Z5EXyHDz14XIDyEe/aomEqAsUqPs8MZirHHzpbaS3LbG5B5VKAKU59bENpf/KOgT a3IUAeQ116xLzgToVdfhEkPj5bxODrWcZtHeTEt1nV+3pc2PS8+QICDOETIDCA/j dhG2brUwbxny6Ap7fU5e1ALU3ryoXKvt9eCXZHooY/p9QIC3koHCWptGD6gKCxlt KWWK5M+HkxhHy4V7Wb137CStzeLda8BdU43Kh0ZQWWjK7pDXKKhHLYIGIawRScQa e6J+y4JR1KKyXIXY94Erxa/POFzuYV/QCJUDpqWFR22bXuy4FhkosLWM8G+UBHVt UfgRxqBas60DhBDWy08eLEADE92TVfJgXOvAOzTqBrP7uZi/Q7ABFFGTQ9n =N4CJ -----END PGP MESSAGE----- Thanks, ``` TOP SEC 0291123 TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## AppIds and Fingerprints Ex: Airline E-Tickets ``` Subject: Airblue E-Ticket - JGDTGSWB From: Airblue Reservations ; To: [REDACTED] Date: Nov 18, 2008 10:41:54 AM E-TICKET airblue Reservation No. [REDACTED] Application AppID (+Fingerprints) mail/webmail/yahoo mail/webmail/yahoo has_fingerprint travel/airblue [REDACTED] Phone 1: [REDACTED] Phone 2: [REDACTED] AZ2749951 21 6876 5648 15E Travel Coupon(s): PHOTO ID REQUIRED AT CHECK-IN [REDACTED] 21 6876 5648/1 ED 610 Peshawar Dubai 29 NOV 08 12:00 O YA900 15,505.00 OK Transactions history details | Date/Time | Method | Location | Description | Amount | | :------------- | :------------ | :-------------------------------- | :---------- | :---------- | | 18-Nov-2008 | | Khaleej Express-Pew | | | | 3:41 PM | Travel Agency | Muhammed Younas, Main Branch | Ticket Sale | Rs 15,505.00 | ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## AppIds and Fingerprints Ex: Extremist Forum Private Messages ``` HTTP Header Information POST /vb/private.php?do=insertpm &pmid= HTTP/1.1 Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-shockwave-flash, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */* Referer: [REDACTED] Accept-Language: en-gb Content-Type: application/x-www-form-urlencoded UA-CPU: x86 Accept-Encoding: gzip, deflate User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; FDM) | Application | AppID (+Fingerprints) | | :---------------------------------------- | :-------------------------------------------------------------- | | mail/webmail/vbulletin/private_message/insert | mail/webmail/vbulletin/private_message/insert has_fingerprint forum/extremist/al-faloja | recipients [REDACTED] bccrecipients title خبر مهم message سنت كتيبة المواجهات التابعة لحركة الشباب المجاهدين بفضل الله مساء يوم الإثنين 08 محرم 1430 هـ الموافق لـ 05-01-2009م هجوما مباشرا وعنيفا على مصنع الباستا للقوات الصليبية الإثيوبية في مقديشو، وشاركت كتيبة المدفعيات في العملية المباركة حيث قامت بقصف المصنع توابل من الصواريخ والمدفعيات واستخدم المجاهدون في الهجوم أساليب قتالية غير مسبوقة مما أرغم على قوات العدو التراجع من دفاعاتها في الشارع العام المؤدي إلى المصنع، وحينما اجتمعوا على جحرهم فاجأتهم كتيبة المدفعيات بقصف عنيف ودقيق ويتوقع خسائر بشرية جسيمة في صفوف القوات الصليبية والله الحمد والمنة ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE Workflows * X-KEYSCORE workflows are standing queries that run on set intervals during the day (usually once a day) * After action reports can E-mail the results of the workflow, parse out data to mailorder to other databases and more * New GUI's Workflow Central makes it easy to create and manage your workflows TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS Workflows: Easy to Create! ``` This system is audited for USSID 18 and Human Rights Act compliance TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, and NZL //20320108 XKEYSCORE Welcome: dtstua2 switch users Home Admin Users Workflow Central Search Results Statistics Preferences Help Navigation Menu * Explorer * Home * Admin * Users * Workflow Central * Request * All Workflows * My Workflows * Search * Classic * MultiSearch * IP Addresses * Mac Address * Username * Classic A-M * ASF and WMV Metada * Alert * BlackBerry * CNE * Call Logs Welcome to the Beta release of the New XKEYSCORE Home Page! If you have questions or bug reports please go to XKEYSCORE New GUI Forum News (U//FOUO) New XKEYSCORE GUI (U//FOUO) XKEYSCORE is working on a new GUI that has now reached an open Beta state. Follow the link below to try it out. Your account and preferences will automatically be transfered when you log in. Please view these training videos to acclimate yourself with the new layout and features. Some features have not yet been completed but will still be available in the original GUI. Try the new XKEYSCORE GUI (Beta)! (U//FOUO) If you find bugs please report them ONLY in the XKEYSCORE Forums under the New GUI section, which can be found here. We will try to fix any bugs as quickly as possible, but when experiencing a problem revert back to the original GUI until we can fix it. ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS Workflows: Easy to Create! ``` Navigation Menu * Workflow Central * Request * All Workflows * Navigation Menu * Workflow Central * Request * All Workflows * My Workflows Workflow Central Request Wizard Welcome to the X-KEYSCORE Workflow Request Wizard. My Workflows Help Actions ▾ | Query Type | Query Name | Last Modified | State | | :---------- | :----------------------------------- | :---------------- | :------ | | | dailywlanfulllogdni2 | 2008-12-05 15:20:10 | on (xks) | | http_parser | Waz_NWWFP_Foriegn_Googlers | 2008-12-01 15:39:11 | on (xks) | | http_parser | Zahedan_Googlers | 2008-11-05 21:35:57 | on (xks) | | http_parser | Google_Earth_Queries | 2008-12-01 15:39:37 | on (xks) | | tech | Kuala_lumpur_tech_tasking | 2008-11-24 15:01:09 | on (xks) | | | megaproxy | 2008-11-24 15:01:09 | on (xks) | | http_parser | Waziristan_NWWFP_Internet_searches | 2008-11-24 15:01:09 | on (xks) | | http_parser | Waz_NWWFP_Googlers_com_pk | 2008-12-01 15:38:48 | on (xks) | | http_parser | Waz_NWWFP_Googlers | 2008-12-01 15:38:35 | on (xks) | | full_log | zahedan_megaproxy | 2008-11-05 21:13:06 | on (xks) | | user_activity | Foreign_Peer_to_Peer_Chats | 2008-11-21 20:40:41 | on (xks) | | http_parser | Guardster_from_Waz | 2008-11-21 20:02:40 | on (xks) | | login | _T_Bone_orange_co_uk_password_ | 2008-12-01 16:19:55 | on (xks) | | tech | Daily_Arabic_from_Waz | 2008-12-02 16:56:28 | on (xks) | | http_parser | Daily_File_Sharing_Uploads_from_Waz | 2008-12-02 16:55:53 | on (xks) | | | daily_wlan_from_moc | 2008-12-16 15:10:50 | on (xks) | | | dailywlan_network_log | 2008-12-16 15:08:22 | on (xks) | ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Context-Aware Tagging * Provides for the ability to task and scan for terms only when they appear inside the body of documents like Microsoft Office or Adobe PDFs * EX: We want to find technical documents regarding WIMAX networks but tasking the term 'WIMAX' to Cadence would flood PINWALE with hits. What if we only look for the term within documents? TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Context-Aware Tagging (Implied) ``` | ID | DATETIME | DATETIME END | TECH NAME | TECH VALUE | TECH FILENAME | | : | :-------------- | :-------------- | :-------- | :--------- | :-------------------- | | 1 | 2008-01-01 04:55:00 | 2008-01-01 04:55:01 | wireless | WIMAX | NIB Ranchor Line KHI.doc | | 2 | 2008-01-01 04:55:00 | 2008-01-01 04:55:01 | satellite | DVB | NIB Ranchor Line KHI.doc | | 3 | 2008-01-01 04:55:00 | 2008-01-01 04:55:01 | mac | [REDACTED] | NIB Ranchor Line KHI.doc | | | | | :-------------------- | :------------------------------- | | BUC Make | | | BUC Frequency | | | LNB Type | Ku | | LNB Frequency | | | DVB-RCS Modem type | DVB STM 1000 | | DVB-RCS Modem Serial | MAC [REDACTED] Serial [REDACTED] | ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Context-Aware Tagging ``` Subject: NFF-66024-GCC-KHI From: [REDACTED] To: [REDACTED] Cc: [REDACTED] Date: Tue Dec 30 10:57:48 GMT 2008 HTML Plain Text Attachment Event T email_ Fm City KLOST IMEI: [REDACTED] Model: 6300 WON: 66024 ASC: GCC-KHI Symptom: 4100 Comments: no fault found phone is working properly kindly confirm the fault in detail when and in which condition it creates problem related to mention symptom [REDACTED] GSM Repair Engineer Tel: [REDACTED] Mob: [REDACTED] Fax: [REDACTED] ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Context-Aware Scanning * Tasking is so flexible that it can include regular expressions (REGEXs) with few or no anchor points * Ex: Can we find documents that have MAC addresses in them? * The following Regex looks for MAC addresses: * `"(00|01|02|04|08|10|3C|44):(?=[\d:]{0,12}[a-f])([\da-f]{2}):([\da-f]{2}):([\da-f]{2}):([\da-f]{2}):([\da-f]{2})"` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Context-Aware Scanning * Supports full foreign language tagging and querying * Ex look for common Arabic expressions in E-mails coming from the Pakistan tribal regions: ``` UIS Webmail Display Windows Live Mail Beta Active user: Unknown From: [REDACTED] ([REDACTED]@gmail.com) Medium risk You may not know this sender. Mark as safe Mark as unsafe Sent: Thu 1/01/09 12:07 PM To: [REDACTED] السلام عليكم ورحمة الله وبركات ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE SIGDEV * X-KEYSCORE's full take database of meta-data and content make it an powerful SIGDEV tool * Many DNI applications don't contain strong selectors that allow traffic to be collected * Web surfing * Internet searching * Anonymous file uploading/downloading * The variety of applications processed and meta-data available make X-KEYSCORE an ideal starting point for DNI development TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE SIGDEV * Scenario 1: Persona Analysis * Goal to identify the \"user session\" * Help answer the question: What did my target do while he was online? * We may know from TRAFFICTHIEF, PINWALE or MARINA that our target was online at a given time and from a given IP address, so we can then search in X-KEYSCORE for everything that happened "around" that event. TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: Persona Analysis | TS | ACTIVE_USER | ACTIVE_USER_IP | ACT | | :--------------- | [REDACTED] | 119.[REDACTED] | PK | | 20081229 051406Z | | | | | 20081229 051406Z | | | | | 20081229 051406Z | | | | | 20081229 051407Z | | | | | 20081229 051409Z | | | | | 20081229 051410Z | | | | | 20081229 051410Z | | | | | 20081229 051410Z | | | | | 20081229 051411Z | | | | | 20081229 051414Z | | | | | 20081229 051415Z | | | | | 20081229 051420Z | | | | | 20081229 051420Z | | | | | 20081229 051421Z | | | | | 20081229 051426Z | | | | | Datetime | Search For | Datetime End | Search Value | Fm IP | To IP | |---------------------|------------|---------------------|------------------|----------------|----------------| | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:07 | username | 2008-12-29 05:14:18 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:09 | username | 2008-12-29 05:14:21 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | 119.[REDACTED] | 209.[REDACTED] | | 2008-12-29 05:14:10 | username | 2008-12-29 05:14:50 | [REDACTED]@yahoo | | | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: Persona Analysis Coming soon: XKS PSC query builder/viewer ``` username 2008-12-29 05:14:18 [REDACTED]@yahoo user_re username 2008-12-29 05:14:18 username 2008-12-29 05:14:21 Persona Session Collection Justification: Persona session collection for to_ip = 209.191.120.3 Additional Justification: Start Date & Time: 12/29/2008 05:09 (M/D/Y H:M) Stop Date & Time: 12/29/2008 05:19 IP (Country Code): 119.[REDACTED] (pk) Also Query IP As: From To X-Forwarded-For IP XFF or Client IP: Add Search: Extracted File ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: Persona Analysis ``` XKEYSCORE Persona Session Collection User List * User 1 * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * User 2 * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] * User 3 * [REDACTED] * [REDACTED] * [REDACTED] * [REDACTED] | User 1 | User 2 | User 3 | HTTP Activity Timeline mail.ru yahoo.com driver.ru com.pk com.tr facebook.com haberler.com rambler.ru topnews.ru imgsmail.ru novoteka.ru city24.ru yimg.com macromedia.com mediarotator.ru google.com. 1hr, 2hr, 3hr, 4hr, 5hr, 6hr, 7hr, 8hr Timeline @ SIMILE Browser List Browser | C Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5 4 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5 3 contype 2 Mozilla Compatible/2.0 (WinNT; I; NCC/2.0) 2 Referer Summary Referred Sites ad.yieldmanager.com (3 Items) chat.yahoo.com (3 Items) facebook.com (2 Items) foto.mail.ru (2 Items) haberler.com (3 Items) import.city24.ru (1 Item) insider.msg.yahoo.com (4 Items) mail.google.com (1 Item) mail.rambler.ru (7 Items) Extracted Files File Name Info Unknown File Extention (1 Item) none Username Summary Usernames mail/webmail/gmail (1 Item) mail/webmail/mailru (2 Items) [REDACTED] [REDACTED] Geographic IP Summary | City | Country | Count | From (2 Items) KOHAT PK 205 XX 1663 To (14 Items) GENEVA CH 2 MOSCOW RU 100 VENI TR 22 ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: Persona Analysis Coming soon: XKS PSC query builder/viewer ``` Username Summary Usernames mail/webmail/gmail (1 Item) mail/webmail/mailru (2 Items) [REDACTED] [REDACTED] mail/webmail/mailru/post (1 Item) [REDACTED] mail/webmail/rambler (2 Items) mail/webmail/rambler/post (1 Item) mail/webmail/yahoo (5 Items) [REDACTED] [REDACTED] [REDACTED] [REDACTED] [REDACTED] Web Searches Terms | Search Engines | (None) (1 Item) none Traffic Summary AppID or Fingerprint | C | advertisement 2 http 6 mail 1 news 2 social 1 unknown 1 Domain Summary Subdomains adinterax.com (2 Items) adriver.ru (1 Item) akamai.net (1 Item) bn5.ru (1 Item) city24.ru (1 Item) com.pk (1 Item) com.tr (1 Item) facebook.com (2 Items) fbcdn.net (1 Item) gismeteo.ru (1 Item) google.com (1 Item) haberler.com (3 Items) imgsmail.ru (1 Item) macromedia.com (3 Items) mail.ru (7 Items) ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## NWFP Example ``` PAKISTAN Why is he looking at London in Google Earth? New strong selector discovered: badguy@yahoo.com Analyst ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: HTTP Traffic Example: font Google queries co reas of Pakistan Informati in HTTP Activity m ``` | Fm IP | To IP | Fm Port | To Port | | 116.[REDACTED] | 65.[REDACTED] | 1233 | 80 | Row Actions View Session View Session (New Window) Show All Row Values Mark Metadata row as Important 116.[REDACTED[ 64.[REDACTED] 2191 80 116.[REDACTED[ 64.[REDACTED] 116.[REDACTED[ 64.[REDACTED] 1053 80 Un-Check where Fm IP Equals '116[REDACTED] NKB Lookup Query Marina Host www.g Fm Country (IP) | Fm PK | BA istan/WLL/PTCL Query Marina for IP: 116.58.126.162 Datetime: 2008-12-29 07:21:42 (+/-) 3 hours OK Cancel ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: HTTP Traffic | TS | USERID | PHONE | USER_A | ACTIVITY | USER_B | | :--------------- | :--------- | :---- | :-------------------- | :-------------------- | :------------- | | 20081119 074259Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074259Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074304Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074316Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074316Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074316Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | START_TIME | STOP_TIME | DURATION | CALL_DONE | IP_ADDRESS | USERID | PHONE_MAC_ADD | | :--------------- | :--------------- | :---------- | :-------- | :------------- | :--------- | :------------ | | 20081119 073141Z | 20081119 092841Z | 0d 01:57:00 | UNK | 116.[REDACTED] | [REDACTED] | [REDACTED] | | | | | | | | |------------------|------------|-------|-----------------------|-----------------------|----------------| | 20081119 074357Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074357Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074357Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074357Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074358Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074358Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074358Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074358Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | | 20081119 074511Z | | | [REDACTED] | logged in (email) 116 | 116.[REDACTED] | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## XKS SIGDEV: HTTP Traffic Now make that into a workflow ``` ========================================= ! X-KEYSCORE EMAILER ! ========================================= QUERY NAME: Waz_NWWFP_Foriegn_Googlers current time: 2008-11-20 07:15:15 GMT submitted at: 2008-11-20 03:55:03 GMT has 14 result(s) ================================================= SEARCHES ================================================= www.google.com -------------- 116.[REDACTED] 2008-11-19 18:54:20 : al qaida (en, en-GB) (1) 116.[REDACTED] 2008-11-19 07:36:49 : The al-Ikhlas network (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 07:37:07 : (referer) the al-Ikhlas network (cybertrans from Arabic) (3) 116.[REDACTED] 2008-11-19 08:03:17 : Forum bride/'Arus (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 08:05:51 : Forum love/gram (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 08:06:52 : (referer) forum love/gram (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 15:01:00 : The hills jihadist without inflicting (cybertrans from Arabic) (10) 116.[REDACTED] 2008-11-19 15:14:13 : (referer) the hills jihadist without inflicting (cybertrans from Arabic) (6) 116.[REDACTED] 2008-11-19 15:33:19 : Waziristan (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 04:24:44 : Scandals (cybertrans from Arabic) (2) 116.[REDACTED] 2008-11-19 04:24:59 : (referer) scandals (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 04:29:29 : News (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 04:30:04 : Forum soil (cybertrans from Arabic) (1) 116.[REDACTED] 2008-11-19 04:31:51 : (referer) forum soil (cybertrans from Arabic) (1) Workflow Values | Workflow XML ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE SIGDEV * EX: Targets pass links to videos, use XKS to discover new targets who have viewed those videos ``` In HB 00215-09, he promises that the newest video will be ready very soon, and then sends these two links: http://www.load.to/[REDACTED] http://www.files.to/get/[REDACTED] ``` ``` Datetime: 2 Weeks Start: 2008-12-23 00:00 Stop: 2009-01-06 23:59 HTTP Type: Host: www.files.to URL Path: /get/ ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE SIGDEV ``` Datet 2008 ``` | TS | USERID | PHONE | USER_A | ACTIVITY | USER_B | | :--------------- | :--------- | :---- | :-------------------- | :------------------ | :------------ | | 20081231 224606Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224949Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224949Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224949Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224952Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224952Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 224952Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 225018Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | | 20081231 225021Z | | | [REDACTED] | logged in (email) | 59.[REDACTED] | TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## X-KEYSCORE SIGDEV How to find technical documents of interest One Idea: Take advantage of the properties exploited as meta-data by X-KEYSCORE like the Author and Organization Lets look for all documents where the organization field is the company we're interested in, ex: Warid Telecom TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 | Filename | Extension | Author | Last Author | Organization | | :-------------------------------------------------- | :-------- | :--------- | :---------- | :------------------------ | | PAR_MPBN_GUJ_To troubleshoot MPBN end for BSC23.doc | doc | [REDACTED] | [REDACTED] | Warid Telecom (Pvt.) Ltd. | | PAR_MPBN_GUJ_To troubleshoot MPBN end for BSC23.doc | doc | [REDACTED] | | Warid Telecom (Pvt.) Ltd. | | wp for bbs troubleshooting 30-12-08.doc | doc | [REDACTED] | [REDACTED] | Warid Telecom (Pvt.) Ltd. | | wp for bbs troubleshooting 30-12-08.doc | doc | [REDACTED] | | Warid Telecom (Pvt.) Ltd. | | Flexo Signs.xls | xls | [REDACTED] | [REDACTED] | Warid Telecom (Pvt.) Ltd. | | Flexo Signs.xls | xls | [REDACTED] | | Warid Telecom (Pvt.) Ltd. | | LOI Warid for 3443 and 3444 Shortcodes.doc | doc | [REDACTED] | [REDACTED] | Warid Telecom (Pvt.) Ltd. | | LOI Warid for 3443 and 3444 Shortcodes.doc | doc | [REDACTED] | | Warid Telecom (Pvt.) Ltd. | | Sohail Malik.xls | xls | [REDACTED] | [REDACTED] | Warid Telecom (Pvt.) Ltd. | Many of these files may have not been selected, because either there was no strong selector associated or the strong selector(s) weren't tasked for collection TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 # Questions? [REDACTED]@nsa xkeyscore@nsa TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## HTTP Activity ``` GET /search?tab=urdu&order=sortboth&q=musharraf&start=3&scope=urdu&link=next. HTTP/1.1 Accept: */* Referer: http://search.bbc.co.uk/search?tab=urdu&order=sortboth&q=musharraf&start=2&scope=urdu Accept-Language: en-us Accept-Encoding: azin. deflate User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) Host: search.bbc.co.uk Cookie: BBC-UID=b479a5f4ad230a53063d513630203acb22684634a0e0b164c45f96efc054cf950Mozilla%2f4%20%20%28co Cache-Control: max-stale=U Connection: Keep-Alive X-BlueCoat-Via: 66808702E9A98546 | Host | URL Path | URL Args | | :------------- | :------- | :------------------------------------------------- | | search.bbc.co.uk | /search | tab=urdu&order=sortboth&q=musharraf&start=3&scope=urdu&link=next | | Search Terms | Language | Browser | Via | | :----------- | :------- | :------------------------------------------- | :----------- | | musharraf | en | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | 66808702E9A98546 | Referer http://search.bbc.co.uk/search?tab=urdu&order=sortboth&q=musharraf&start=2&scope=urdu Cookie BBC-UID=b479a5f4ad230a53063d513630203acb22684634a0e0b164c45f96efc054cf950Mozilla%2f4%2e0%20%28co ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 --- TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123 ## Query Hierarchy ``` User Queries Query X-KEYSCORE Central Query Query Query F6 HQS FORNSAT site SSO site Query Query F6 Site 1 F6 Site 2 ``` TOP SECRET//COMINT//ORCON,REL TO USA, AUS, CAN, GBR and NZL//20291123