first commit

This commit is contained in:
libroot 2026-11-19 04:39:11 +02:00
commit 0d90363116
Signed by: libroot
GPG key ID: 2AC68C029EBE9ACE
6510 changed files with 679146 additions and 0 deletions

View file

@ -0,0 +1,529 @@
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
# LEVITATION and the FFU Hypothesis
[REDACTED]
[REDACTED]@cse-cst.gc.ca
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## What is LEVITATION?
* A behaviour-based target discovery project
* Multi-disciplinary team
* Prototyping and delivering advances in:
* Behavioural tradecraft
* Hypothesis tradecraft
* Tradecraft automation
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Current Hypotheses
Active
FFU
[REDACTED]
[REDACTED]
[REDACTED]
Sequential numbers
Obvious selector names
Web search terms
In Development
GPS waypoints
Devices close to places
Telephony gaps
[REDACTED]
Targets of foreign SIGINT agencies
Missed calls
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## FFU Hypothesis
Extremists use Free File Upload (FFU) sites differently than the general public.
Al-Qaida uses FFU sites to distribute Jihadist propaganda
Extremists use FFU sites to distribute training materials
```
اصنع سلاحك بنفسك
القنابل اليدوية
GREN
FRAG
5.69 COM
مؤسسة المهاجر الإعلامية
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## What do we need?
A list of suspect documents
A list of FFU URLs referring to those documents
A list of IPs downloading those URLs
New documents are found by CWOC (CSEC Web Operations Centre) retrieval from URLs, so that's the easy part.
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## New URLs
CSEC's web forums team
2nd Party reports & alerts
Machine Learning
Learning the textual context for the URLs in web forums
HTTP Referrers
Follow URL referrers back to the originating site
Previous Correlations analysis
Using tech techniques to figure out what else that user was up to at the same time
e.g. Google analytics cookies
---
```
Get STALKER Hostnames
String operations
Build SQL for STALKER Referers
Dummy 1
Query FFU for STALKER Referers
TC Init
Generate Rows
Calculator
Build SQL for referers count
Filter out images
Memory Group by
Sort rows
Select values 2
Filter out heavy hiters
Dummy 3
Query referers count
Dummy 2
Select values
IP Geo and Network Info
Dummy 4
Dummy 5
Filter out Referer count = 1
Prepare deduping string
Filter out duplicates
Add constants
FFU Requests Master List
Remove spaces
Stream lookup
TC Init 2
Output duplicated URLs
Format Date
Mail New URLs
Get Variables
Mail Configs
Blocking Step
New URLs File
Select values 4
Output new URLs
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## FFU Events Collection
ATOMIC BANJO (Special Source) is collecting HTTP metadata for 102 known FFU sites.
sendspace
RAPIDSHARE
EASY FILEHOSTING
MEGAUPLOAD
We see about 10-15 million FFU events per day
All the FFU Events are available thru OLYMPIA
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Looking for a few good documents
We only care about the 2,200 URLs that point to documents of interest.
e.g. How to make a gas bomb
www.sendspace.com/file/[REDACTED]
Every day we sort through the 10–15M events for the interesting ones.
We're finding about 350 interesting download events per month.
```
- إدخال الورق
المقوى
العلبة
محتويات العلبة
من الداخل
Nestle
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Documents vary
Chloroform in a Lowes bucket
Bajadin Explosives Manual
And lots of pictures of cars on fire
```
شكل المنبه من الداخل
هو جري
تغذ
انه به سلکی
سلك سلك
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Filtering out Glee Episodes
```
Create HTTP_RLINE SQL
Dummy 1
Query HTTP_RLINE
TC Init
Geo
Sort by time
Master List Extremist Documents URLs
Create UTC Date
Get URL Length
Convert String IPs
Master FFU Hits
Add constants
Stream lookup
Create HTTP_LOCATION SQL
Dummy 2
Query HTTP_LOCATION
Filter rows
Processed FFU records
New FFU records
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Resulting events
```
FFU Hits
Computer shares (\\corp) (R:) Share_1 Levitation FFU FFU Hits
File Edit View Tools Help Search FFU Hits
Organize Open New folder
Favorites
Desktop
Downloads
Recent Places
Libraries
Desktop
Documents
Music
Pictures
Videos
Computer
Windows (C:)
DVD Drive (D:)
[REDACTED]\\corp\users\csec_users) (H:)
shares (\\corp) (R:)
Reserved
Share_1
Share_2
Share_3
Share_4
Share_5
Share_6
Tempshare
apps (\\corp\groups\sigint) (S:)
Network
Control Panel
Recycle Bin
CERRID DM Extension
SQL Developer
XMind
sqldeveloper-3.1.06.82
```
| Name | Date modified | Type | Size |
| :-------------------------- | :------------------ | :---------- | :----- |
| 01-20-2012 FFU Hit Selecto[REDACTED]raq | 06/03/2012 10:27 | File folder | |
| 01-20-2012 FFU Hit Selecto[REDACTED] Iraq | 06/03/2012 8:32 AM | File folder | |
| 01-20-2012 FFU Hit Selecto[REDACTED]Saudi Arabia | 07/02/2012 12:15... | File folder | |
| 01-21-2012 FFU Hit Selecto[REDACTED]Yemen | 19/03/2012 11:47... | File folder | |
| 01-21-2012 FFU Hit Selecto[REDACTED]Occupied Palestinian Territory | 08/03/2012 10:36... | File folder | |
| 01-21-2012 FFU Hit Selecto[REDACTED]Saudi Arabia | 10/02/2012 1:41 PM | File folder | |
| 01-22-2012 FFU Hit Selecto[REDACTED]Occupied Palestinian Territory | 07/02/2012 12:15... | File folder | |
| 01-23-2012 FFU Hit Selecto[REDACTED]Spain | 09/02/2012 10:41 | File folder | |
| 01-25-2012 FFU Hit Selecto[REDACTED]Syria | 06/03/2012 12:20... | File folder | |
| 01-27-2012 FFU Hit Selecto[REDACTED]UK | 06/03/2012 12:38... | File folder | |
| 01-28-2012 FFU Hit Selecto[REDACTED]Occupied Palestinian Territory | 09/02/2012 10:54... | File folder | |
| 01-31-2012 FFU Hit Selecto[REDACTED]Syria | 05/03/2012 10:26... | File folder | |
| 02-01-2012 FFU Hit Selecto[REDACTED]US | 05/03/2012 10:36. | File folder | |
| 02-02-2012 FFU Hit Selecto[REDACTED]Spain | 07/02/2012 12:17... | File folder | |
| 02-06-2012 FFU Hit Selecto[REDACTED]Germany | 08/03/2012 9:35 AM | File folder | |
| 02-13-2012 FFU Hit Selecto[REDACTED]Yemen | 23/03/2012 10:02... | File folder | |
| 02-13-2012 FFU Hit Selecto[REDACTED]US | 08/03/2012 9:52 AM | File folder | |
| 02-14-2012 FFU Hit Selecto[REDACTED]Kuwait | 05/03/2012 10:57... | File folder | |
| 02-15-2012 FFU Hit Selecto[REDACTED]Senegal | 22/03/2012 12:25. | File folder | |
| 02-17-2012 FFU Hit Selecto[REDACTED]Bahrain | 09/03/2012 8:57 AM | File folder | |
| 02-18-2012 FFU Hit Selecto[REDACTED]Canadian Anonymizer | 05/03/2012 1:16 PM | File folder | |
| 02-20-2012 FFU Hit Selecto[REDACTED]Jordan | 09/03/2012 8:55 AM | File folder | |
| 02-22-2012 FFU Hit Selecto[REDACTED]Morocco | 09/03/2012 8:54 AM | File folder | |
| 02-24-2012 FFU Hit Selecto[REDACTED]Yemen | 09/03/2012 9:50 AM | File folder | |
| 02-28-2012 FFU Hit Selecto[REDACTED]Qatar | 09/03/2012 2:26 PM | File folder | |
| 02-28-2012 FFU Hit Selecto[REDACTED]Kuwait | 20/03/2012 9:33 AM | File folder | |
| 02-28-2012 FFU Hit Selecto[REDACTED]Brazil | 20/03/2012 9:53 AM | File folder | |
| 03-01-2012 FFU Hit Selecto[REDACTED]Jordan | 22/03/2012 12:45... | File folder | |
| 03-03-2012 FFU Hit Selecto[REDACTED]Yemen | 22/03/2012 1:18 PM | File folder | |
| 03-03-2012 FFU Hit Selecto[REDACTED]Portugal | 27/03/2012 10:59... | File folder | |
| 03-04-2012 FFU Hit Selecto[REDACTED]Canadian Anonymizer | 22/03/2012 1:29 PM | File folder | |
| 03-07-2012 FFU Hit Selecto[REDACTED]Kenya | 27/03/2012 12:58... | File folder | |
| 03-07-2012 FFU Hit Selecto[REDACTED]Yemen | 28/03/2012 11:07... | File folder | |
| 03-10-2012 FFU Hit Selecto[REDACTED]Jordan | 28/03/2012 11:13... | File folder | |
| 03-16-2012 FFU Hit Selecto[REDACTED]Jordan | 28/03/2012 1:09 PM | File folder | |
| 03-20-2012 FFU Hit Selecto[REDACTED]Morocco | 29/03/2012 11:18... | File folder | |
| FFU From Mathieu | 09/03/2012 3:02 PM | Microsoft Excel W... | 19 KB |
| 01-20-2012 FFU Hit Selecto[REDACTED] | Date modified: 06/03/2012 10:27 AM | Offline status: Online | |
| File folder | Offline availability Not available | | |
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Start analysis with event info
```
FFU hit from selector [REDACTED] on
7/03/2012 7:46:51 geolocated to Kenya,
accessing The Explosives Course through
FFU site sendspace.com with HTTP user
agent Mozilla/5.0 (Ubuntu; X11; Linux
x86_64; rv:9.0.1) Gecko/20100101 Firefox/
9.0.1
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Correlating other selectors with the IP
```
FFU hit from selector [REDACTED] on
7/03/2012 7:46:51 geolocated to Kenya,
accessing The Explosives Course through
FFU site sendspace.com with HTTP user
agent Mozilla/5.0 (Ubuntu; X11; Linux
x86_64; rv:9.0.1) Gecko/20100101 Firefox/
9.0.1
```
Can we correlate any other selectors with this IP address?
Mutant Broth query on IP [REDACTED] for 5 hours on either side of 7/03/2012 7:46:51
682 events including 77 with an exact match of the user agent above yielding
a Facebook ID [REDACTED]a Google Prefid Cookie [REDACTED] an
M_Adnxs Uuid2 Cookie [REDACTED] an M_Quantserve Mc Cookie
and a Google Prefid Cookie [REDACTED]
New Selectors
FFU Hit Selector [REDACTED] March 7, 2012. Mutant Broth query.xlsx [REDACTED]
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Correlating Facebook cookie
```
FFU hit from selector [REDACTED] on
7/03/2012 7:46:51 geolocated to Kenya,
accessing The Explosives Course through
FFU site sendspace.com with HTTP user
agent Mozilla/5.0 (Ubuntu; X11; Linux
x86_64; rv:9.0.1) Gecko/20100101 Firefox/
9.0.1
```
Can we correlate any other selectors with this Facebook ID Cookie?
Open Source research indicates that the user of Facebook ID [REDACTED]s based in Dubai, United Arab Emirates
Marina Profile Query on Facebook User Cookie [REDACTED] observed in Mutant Broth Query above
Lots of events including registration email address [REDACTED]@gmail.com and Facebook name [REDACTED]
New Selectors
FFU Hit Selector [REDACTED] March 7, 2012. Marina Profile Query on Facebook ID [REDACTED]xlsx
Mutant Broth Sub-Query on Facebook User Cookie [REDACTED] observed in Mutant Broth Query above
946 events with 893 matching exactly the user agent above
FFU Hit Selector [REDACTED] March 7, 2012. Mutant Broth Sub-Query on Facebook ID [REDACTED]xlsx
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## IP Correlation
```
FFU Hits Analysis.kjb MUTANTBROTH TDIs.ktr
100%
Hide the execution results pane
Get rows from result
Multi-Threads
Cut justification to 150 chars
MUTANT BROTH
Filter Empty Result
MB Raw Results
Sort by Sequence
Group TDIs/User-Agents
Error Handling
Ignore Empty Result
MB TDIs
Calc Confidence
Sort by Confidence
Filter on User-Agent
Different U.-A.
Groups
+ [REDACTED] (27)
+ [REDACTED] (27)
+ [REDACTED] (84)
+ [REDACTED] (12)
- Mozilla/4.0 (compatible; MSIE 6.0; Win
[REDACTED] (2)
[REDACTED] (5)
- Mozilla/4.0 (compatible; MSIE 8.0; Win
[REDACTED] (5)
```
| Document_Link | Document_Title/Description | EVENT_TIMESTAMP | ACTIVITY DATE | Confidence_Number | ACTIVE USER |
| :--------------------- | :------------------------- | :---------------------------- | :--------------------- | :---------------- | :---------- |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:32:32 GMT 2012 | 2012-03-28T18:18:00Z | 1.0 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:32:32 GMT 2012 | 2012-03-28T18:18:00Z | 1.0 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:32:32 GMT 2012 | 2012-03-28T18:18:17Z | 1.0 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:32:32 GMT 2012 | 2012-03-28T18:18:17Z | 1.0 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:23:42 GMT 2012 | 2012-03-28T18:09:27Z | 0.5 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:23:42 GMT 2012 | 2012-03-28T18:09:27Z | 0.5 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:23:42 GMT 2012 | 2012-03-28T18:18:00Z | 0.5 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:23:42 GMT 2012 | 2012-03-28T18:18:00Z | 0.5 | [REDACTED] |
| archive.org/almapl.mp4 | German hostage video | Wed Mar 28 18:23:42 GMT 2012 | 2012-03-28T18:18:17Z | 0.5 | [REDACTED] |
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Automated analysis documentation
```
Workbook 1 20120120000848 188.51.88.22 saudi arabia.xmind
Create a relationship (Ctrl+L)
Analytic Process for FFU Hypothesis Hits
FFU hit from selector [REDACTED] on
20120120000848000GMT geolocated to
SA, accessing Inexhaustible weapons
part 2 through FFU site GET /download
/sela7_la_yndb_02/part24.mp4 HTTP
/1.1 with HTTP user agent Mozilla/5.0
(SymbianOS/9.3; U; Series60/3.2
NokiaN79-1/11.049; Profile/MIDP-2.1
Configuration/CLDC-1.1) AppleWebKit/
413 (KHTML, like Gecko) Safari/413
Can we correlate any other selectors with this IP address?
Mutant Broth query on IP [REDACTED] for 5 hours on either side of 20120120000848000GMT
(_MUTANTBROTH_EVENT_COUNT_) events with only
(_MUTANTBROTH_MATCHING_EVENT_COUNT) matching exactly the us agent above.
New Selectors
FFU Hit Selector[REDACTED]
Marina Activity query on IP [REDACTED] for 5 hours on either side of 20120120000848000GMT
(_MARINA_ACTIVITY_EVENT_COUNT_) events with possible correlation
(_MARINA_ACTIVITY_POSSIBLE_CORRELATIONS_)
```
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## What happens then?
* Compare control and experimental groups to show statistical differences
* Analyse experimental group to determine statistical power of the hypothesis
* Assemble selectors across all hypotheses
* Rank selectors according to the number and power of the hypothesis behaviors they show
* Deliver an ordered list of suspects to OCT
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Scoreboard
Hypotheses
| Personae | FFU | [REDACTED] | [REDACTED] | [REDACTED] | ... | Totals |
| :------- | :---- | :--------- | :--------- | :--------- | :-- | :----- |
| Weights | 0.6 | 0.55 | 0.52 | 0.48 | | |
| P1 | 4 | 2 | 0 | 4 | | 5.42 |
| P2 | 4 | 4 | 0 | 1 | | 5.08 |
| P3 | 4 | 1 | 0 | 4 | | 4.87 |
| P4 | 3 | 4 | 4 | 0 | | 3.14 |
| ... | | | | | | |
Known New
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## Successes
* An HTTP-referred URL gave us a German hostage video from a previously unknown target.
* An [REDACTED] FFU upload event gave us an AQIM's hostage strategy. The resulting report was disseminated widely including by the CIA to their counterparts overseas.
---
TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA
## The End
Team Lead: [REDACTED] ([REDACTED]@cse-cst.gc.ca)
Tech Lead: [REDACTED] ([REDACTED]@cse-cst.gc.ca)
Me: [REDACTED] ([REDACTED]@cse-cst.gc.ca)

View file

@ -0,0 +1,126 @@
{
"title": "LEVITATION and the FFU Hypothesis",
"type": "REPORTED",
"description": "This document describes LEVITATION, a top-secret Canadian Communications Security Establishment (CSE) project that monitors millions of daily file uploads and downloads from free file-sharing sites to identify potential extremist activity. It details the program’s data collection methods, analytical workflow, use of partner databases, and examples of successful discoveries related to terrorist materials and hostage videos.",
"long_description": "This LEVITATION document outlines a top-secret program operated by Canada’s Communications Security Establishment (CSE), developed to identify and track potential extremist activities through large-scale surveillance of free file upload (FFU) websites. The project, part of the broader Five Eyes intelligence network, used behavioral and hypothesis-based analytics to detect suspicious downloads or uploads among the roughly 10 to 15 million daily events observed across more than 100 popular file-sharing sites such as Sendspace, RapidShare, and MegaUpload. By examining patterns in user activity, CSE analysts aimed to isolate a small number of “documents of interest” related to extremist propaganda, training materials, or bomb-making guides, while filtering out vast amounts of benign content.\n\nThe system’s workflow relied on automated data processing and correlation tools, integrating inputs from multiple databases and “special sources.” When a suspicious file transfer was detected, analysts used partner intelligence databases—such as the UK’s MUTANT BROTH and the NSA’s MARINA—to trace related IP addresses, cookies, and social media profiles, allowing them to map online behaviors and potentially identify individuals involved. The presentation includes examples of such findings, including the discovery of a German hostage video and an Al-Qaeda in the Islamic Maghreb (AQIM) hostage strategy document.\n\nLEVITATION represents a sophisticated example of mass data mining, combining metadata analysis, behavioral modeling, and cross-agency intelligence sharing. While the document frames the project as an innovative analytical effort to automate extremist detection, it also illustrates the scale and intrusiveness of such surveillance systems, which indiscriminately capture global user data in the process of isolating a few actionable leads.",
"tags": [
"CSE",
"Five Eyes",
"intelligence sharing",
"mass surveillance",
"signals intelligence",
"metadata analysis",
"behavioral analysis",
"hypothesis-driven analysis",
"counterterrorism",
"extremism",
"jihad",
"data mining",
"file sharing",
"file upload",
"free file upload sites",
"FFU",
"cyber surveillance",
"automated analysis",
"web traffic analysis",
"HTTP",
"big data",
"pattern recognition",
"user profiling",
"machine learning",
"web forums",
"forums",
"internet surveillance",
"NSA collaboration",
"GCHQ collaboration",
"global surveillance",
"data repository",
"web operations center",
"CWOC",
"selectors",
"cookie tracking",
"Facebook",
"IP geolocation",
"user identification",
"anonymizers",
"statistical analysis",
"automation",
"data processing",
"network traffic analysis"
],
"document": {
"creator": "CSE",
"date_created": "2012",
"classification": [
"TOP SECRET",
"SI"
],
"dissemination": [
"REL CAN, AUS, GBR, NZL, USA"
],
"banner": "TOP SECRET//SI//REL CAN, AUS, GBR, NZL, USA",
"genre": "slides",
"programs": [
"LEVITATION",
"STALKER",
"ATOMIC BANJO",
"OLYMPIA",
"MUTANT BROTH",
"MARINA"
],
"countries": [
"Iraq",
"Saudi Arabia",
"Yemen",
"Palestine",
"Spain",
"Syria",
"Germany",
"Kuwait",
"Senegal",
"Bahrain",
"Canada",
"Jordan",
"Morocco",
"Qatar",
"Brazil",
"Portugal",
"Kenya",
"United Arab Emirates"
],
"people": []
},
"publication": [
{
"publisher": "CBC News",
"date_published": "2015-01-27",
"title": "CSE tracks millions of downloads daily: Snowden documents",
"link": "https://www.cbc.ca/news/canada/cse-tracks-millions-of-downloads-daily-snowden-documents-1.2930120",
"reporters": [
"Seglins, Dave"
],
"contributors": [
"Hildebrandt, Amber",
"Pereira, Michael",
"Greenwald, Glenn",
"Gallagher, Ryan"
],
"doc_url": "https://s3.documentcloud.org/documents/1510163/cse-presentation-on-the-levitation-project.pdf"
},
{
"publisher": "The Intercept",
"date_published": "2015-01-28",
"title": "Canada Casts Global Surveillance Dragnet Over File Downloads",
"link": "https://theintercept.com/2015/01/28/canada-cse-levitation-mass-surveillance/",
"reporters": [
"Gallagher, Ryan",
"Greenwald, Glenn"
],
"contributors": [],
"doc_url": "https://s3.documentcloud.org/documents/1510163/cse-presentation-on-the-levitation-project.pdf"
}
],
"aka_id": [],
"pdf_sha256": "9c87473d94f37a2211e1edb0c99a1578dfadcacf95a062b8506f6f447cfccc43",
"pages": 21
}