first commit

This commit is contained in:
libroot 2026-11-19 04:39:11 +02:00
commit 0d90363116
Signed by: libroot
GPG key ID: 2AC68C029EBE9ACE
6510 changed files with 679146 additions and 0 deletions

View file

@ -0,0 +1,86 @@
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
# BOUNDLESSINFORMANT
Describing Mission Capabilities from Metadata Records
[REDACTED]
13 July 2012
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## THE OLD WAY
(U//FOUO) Typical SIGINT Data Calls/Questions
1. How many sites do we have in the region? How many records are they producing?
2. What type of coverage do we have on country X?
3. What type of collection and volume do we get out of site A? How do these
types/volumes compare against site B? Against site C?
(U//FOUO) Ways to Get Answers
1. Map out the physical location of SIGINT assets
2. Send out a data call based on best guesses for who can answer the question
3. Review static reports/spreadsheets from previous data calls
4. Ask a 30-year SIGINTer
TOP SECRET//SI//NOFORN
3
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## THE NEW WAY BOUNDLESSINFORMANT
(U//FOUO) Use Big Data technology to query SIGINT collection in the cloud to produce near real-time business intelligence describing the agency's available SIGINT infrastructure and coverage.
(U//FOUO) Key Questions
1. How many records are collected for an organizational unit (e.g. FORNSAT) or country?
2. Are there any visible trends?
3. What assets collect against a specific country? What type of collection?
4. What is the field of view for a specific site? What type of collection?
(U//FOUO) Potential Users
1. Strategic decision makers (leadership team)
2. Tactical users (mission and collection managers)
TOP SECRET//SI//NOFORN
5
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## DETAILS
1) (U//FOUO) Current focus is on SIGINT/COMINT
2) (U//FOUO) Review every valid DNI and DNR metadata record passing through the NSA SIGINT infrastructure
a) (U//FOUO) For the Map View, only display aggregated counts of records with a normalized number or an administrative region populated.
b) (U//FOUO) For the Org View, display aggregated counts of every valid record.
3) (U//FOUO) Raw data, analytics, and back-end database are all conducted in the cloud (HDFS, MapReduce, Cloudbase).
(U//FOUO) BOUNDLESSINFORMANT is hosted entirely on corporate services
and leverages FOSS technology (i.e. available to all NSA developers).
TOP SECRET//SI//NOFORN
6

View file

@ -0,0 +1,142 @@
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
# BOUNDLESSINFORMANT
Describing Mission Capabilities from Metadata Records
[REDACTED]
13 July 2012
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## THE QUESTION
(U//FOUO) How do we describe the collection capabilities and posture of our SIGINT infrastructure?
TOP SECRET//SI//NOFORN
2
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## THE OLD WAY
(U//FOUO) Typical SIGINT Data Calls/Questions
1. How many sites do we have in the region? How many records are they producing?
2. What type of coverage do we have on country X?
3. What type of collection and volume do we get out of site A? How do these
types/volumes compare against site B? Against site C?
(U//FOUO) Ways to Get Answers
1. Map out the physical location of SIGINT assets
2. Send out a data call based on best guesses for who can answer the question
3. Review static reports/spreadsheets from previous data calls
4. Ask a 30-year SIGINTer
TOP SECRET//SI//NOFORN
3
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## THE NEW WAY BOUNDLESSINFORMANT
(U//FOUO) Use Big Data technology to query SIGINT collection in the cloud to produce near real-time business intelligence describing the agency's available SIGINT infrastructure and coverage.
(U//FOUO) Key Questions
1. How many records are collected for an organizational unit (e.g. FORNSAT) or country?
2. Are there any visible trends?
3. What assets collect against a specific country? What type of collection?
4. What is the field of view for a specific site? What type of collection?
(U//FOUO) Potential Users
1. Strategic decision makers (leadership team)
2. Tactical users (mission and collection managers)
TOP SECRET//SI//NOFORN
5
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## DETAILS
1) (U//FOUO) Current focus is on SIGINT/COMINT
2) (U//FOUO) Review every valid DNI and DNR metadata record passing through the NSA SIGINT infrastructure
a) (U//FOUO) For the Map View, only display aggregated counts of records with a normalized number or an administrative region populated.
b) (U//FOUO) For the Org View, display aggregated counts of every valid record.
3) (U//FOUO) Raw data, analytics, and back-end database are all conducted in the cloud (HDFS, MapReduce, Cloudbase).
(U//FOUO) BOUNDLESSINFORMANT is hosted entirely on corporate services
and leverages FOSS technology (i.e. available to all NSA developers).
TOP SECRET//SI//NOFORN
6
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## DEMO
TOP SECRET//SI//NOFORN
7
---
---
TOP SECRET//SI//NOFORN
GAO
Global Access Operations
The mission never sleeps...
## ROAD MAP
1) (U//FOUO) Add technology type (e.g. JUGGERNAUT, LOPER) to provide additional granularity in the numbers
2) (U//FOUO) Integrate Site Similarity capability (i.e. Gephi Charts)
3) (U//FOUO) Anomaly detection and alerts
4) (U//FOUO) Other "INT” data (e.g. ELINT, FISINT)
5) (U//FOUO) Add survey data and display delta between collected metadata
and survey data
6) (U//FOUO) Add in selected (vs. unselected) data indicators
TOP SECRET//SI//NOFORN
8