76 lines
4.1 KiB
JSON
76 lines
4.1 KiB
JSON
{
|
|
"title": "NGE BLACK HOLE ConOp",
|
|
"type": "REPORTED",
|
|
"description": "This document outlines the \"BLACK HOLE\" Concept of Operations (ConOp) for the \"Next Generation Events\" (NGE) project within \"BLAZING SADDLES,\" detailing a flat file data store designed to house various intelligence feeds. Its primary purpose is to serve as a source for Query Focused Datasets (QFDs) and support research, bulk analysis, and target discovery, with two operational instances at Benhall and Bude handling massively increased data volumes.",
|
|
"long_description": "The \"Next Generation Events (NGE) - BLACK HOLE ConOp\" describes BLACK HOLE as a flat file store that collects and houses data from a wide range of feeds, including Target Detection Identifiers (TDIs) and encrypted content. While not a traditional queryable database, it offers an HTTP interface for basic data extraction by type or date. Originally developed by Technology Research (TR), BLACK HOLE is being \"tech-transferred\" as part of the \"BLAZING SADDLES\" project to populate key operational Internet profiling tools like MUTANT BROTH, KARMA POLICE, and SOCIAL ANIMAL via Query Focused Datasets (QFDs), which draw data from a separate 5-day buffer repository.\n\nThe NGE BLACK HOLE system will feature two instances, located at Benhall and Bude, designed to accommodate significantly increased data volumes (up to 50 gigabits per second feeds). This expansion is expected to bring numerous business benefits, including enabling rapid QFD prototyping, facilitating bulk data analysis and statistical methods, accelerating the integration of new data sources, and enhancing target discovery for operations. The data stored on NGE BLACK HOLE is classified at TOP SECRET STRAP2 CHORDAL with a retention period of 6 months, subject to legal and policy review.\n\nAccess to BLACK HOLE data is primarily managed through the BLACKFIND and BLACKCAT HTTP interface, with initial coarse-grained access restricted to CHORDAL COI members. Users from Technology Research, Operations, and Crypt Target Discovery and SIGINT Development (OPC-TDSD) will leverage BLACK HOLE for testing QFDs, performing off-line processing, and conducting data mining research. The document also introduces the critical \"BLACK HOLE Manager Role\" responsible for user accounts, legal compliance, security, user support, and the lifecycle management of QFDs, ensuring the system operates effectively and efficiently while adhering to stringent security and legal requirements.",
|
|
"tags": [
|
|
"surveillance architecture",
|
|
"surveillance databases",
|
|
"Next Generation Events",
|
|
"CONOP",
|
|
"Concept of Operations",
|
|
"flat file store",
|
|
"data feeds",
|
|
"automation",
|
|
"QFD",
|
|
"internet profiling",
|
|
"buffer repository",
|
|
"Benhall",
|
|
"Bude",
|
|
"data volume",
|
|
"bulk collection",
|
|
"target discovery",
|
|
"research",
|
|
"data retention"
|
|
],
|
|
"document": {
|
|
"creator": "GCHQ",
|
|
"date_created": "2009-08-18",
|
|
"classification": [
|
|
"SECRET",
|
|
"STRAP 1"
|
|
],
|
|
"dissemination": [],
|
|
"banner": "SECRET STRAP1",
|
|
"genre": "manual",
|
|
"programs": [
|
|
"NGE",
|
|
"BLAZINGSADDLES",
|
|
"BLACKHOLE",
|
|
"MUTANTBROTH",
|
|
"KARMAPOLICE",
|
|
"SOCIALANIMAL",
|
|
"TELLURIAN",
|
|
"BUFFER",
|
|
"MAILORDER",
|
|
"MARBLEDGECKO",
|
|
"SALAMANCA",
|
|
"SMOKINGSADDLES",
|
|
"CIRCUIT",
|
|
"BLACKFIND",
|
|
"BLACKCAT",
|
|
"DATAFLOWCAB",
|
|
"CHORDAL",
|
|
"DEBIT CARD",
|
|
"B13B"
|
|
],
|
|
"countries": [],
|
|
"people": []
|
|
},
|
|
"publication": [
|
|
{
|
|
"publisher": "The Intercept",
|
|
"date_published": "2015-09-25",
|
|
"title": "Profiled: From Radio to Porn, British Spies Track Web Users' Online Identities",
|
|
"link": "https://theintercept.com/2015/09/25/gchq-radio-porn-spies-track-web-users-online-identities/",
|
|
"reporters": [
|
|
"Gallagher, Ryan"
|
|
],
|
|
"contributors": [],
|
|
"doc_source": "https://theintercept.com/document/2015/09/25/nge-black-hole-conop/",
|
|
"doc_url": "https://s3.documentcloud.org/documents/2432292/nge-black-hole-conop.pdf"
|
|
}
|
|
],
|
|
"pdf_sha256": "86e2d2c396d34adad4d2bc5751fff11cf656e0b4128bfa971ad68f2677252739",
|
|
"pages": 13
|
|
}
|