first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
62
data/black-budget-262/black-budget-262.md
Normal file
62
data/black-budget-262/black-budget-262.md
Normal file
|
|
@ -0,0 +1,62 @@
|
|||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
This Exhibit is SECRET//SI//NOFORN
|
||||
Total Funding in Millions
|
||||
|
||||
CCP_00083 - Number of voice files rendered searchable by text queries.
|
||||
Projects: Analytics Modernization
|
||||
|
||||
| Fiscal Year | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 |
|
||||
| :---------- | :---------- | :-------- | :------ | :------ | :------ | :------ |
|
||||
| Funding | - | - | - | $423.8 | $512.5 | $427.4 |
|
||||
| Target | 1,000,000 | 300,000 | 500,000 | 350,000 | 350,000 | 400,000 |
|
||||
| Result | 256,000 | 263,000 | 253,871 | 285,337 | - | - |
|
||||
|
||||
Results and Expected Performance: In FY 2011, the FY 2011 target was not met due to decommissioning of VoiceRT systems deployed outside NSA-Washington. The decommissioning was in preparation for deployment of a more robust voice analytic system in FY 2012. Processing volumes fluctuated during FY 2011. By FY 2013, NSA/CSS expects to have operationalized a more robust voice processing capability based on speech-to-text keyword search and paired dialogue transcription.
|
||||
|
||||
CCP_00103 - Average cost to deliver an analytic hour equivalent for Level 0, Level 1, Level 2, and Level 3 activities (in dollars per hour).
|
||||
Projects: Analytic Operational Support, Analytics Modernization
|
||||
|
||||
| Fiscal Year | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 |
|
||||
| :---------- | :--- | :--- | :--- | :--- | :--- | :--- |
|
||||
| Funding | - | - | - | $595.3 | $688.0 | $607.0 |
|
||||
| Target | 1.12 | 1.04 | .93 | .84 | .22 | .21 |
|
||||
| Result | .57 | .70 | .29 | .23 | - | - |
|
||||
|
||||
Results and Expected Performance: In FY 2011, the voice analytic system at NSA/CSS Washington (NSAW) processed 345,000 voice cuts. This growth in machine translation (MT) services utilization resulted in greater than expected analytic efficiency. Due to higher than expected analytic efficiency from the growth in MT services utilization, NSA/CSS is adopting more ambitious future targets for this measure. In FY 2013, more robust voice analytic and machine translation systems will be in operation across the SIGINT enterprise, analyzing greater volumes of data at higher speeds. Productivity increases will further lower the analytic hour equivalent cost.
|
||||
|
||||
CCP_00169 - Percentage of intended storage capacity available as a result of the enterprise distributed database architecture.
|
||||
Projects: Analytics Modernization
|
||||
|
||||
| Fiscal Year | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 |
|
||||
| :---------- | :--- | :--- | :--- | :----- | :----- | :--..- |
|
||||
| Funding | - | - | - | $423.8 | $512.5 | $427.4 |
|
||||
| Target | 1 | 2 | 44 | 75 | 100 | - |
|
||||
| Result | 0 | 1 | 48 | 55 | - | - |
|
||||
|
||||
Results and Expected Performance: The FY 2011 target was not achieved because a major deployment was rescheduled for late CY 2011 due to a decision to move the system into a government-leased facility as well as a system change that required additional engineering. NSA/CSS expects to complete the deployment of its content storage capacity in FY 2012 allowing NSA/CSS to establish its operational content storage baseline for analyst use. Therefore, this measure will be discontinued, effective FY 2013.
|
||||
|
||||
CCP_00179 - Percent of analysts that have completed digital network intelligence (DNI) core training curriculum.
|
||||
Projects: Linguists/Translators
|
||||
|
||||
| Fiscal Year | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 |
|
||||
| :---------- | :--- | :--- | :------- | :--- | :--- | :--- |
|
||||
| Funding | | | | $228.1 | $226.8 | $217.5 |
|
||||
| Target | | | Baseline | 60 | 55 | 55 |
|
||||
| Result | | | 42 | 55 | 53 | |
|
||||
|
||||
Results and Expected Performance: The target was not met due to an unexpected rate of analyst attrition toward the end of FY 2011. While NSA/CSS fell short of its target, the number of analysts who received DNI core training increased by 500 each quarter. In FY 2013, NSA/CSS will continue to identify DNI core training gaps and address them with more DNI-specific development plans. This will ensure NSA/CSS analysts are capable of meeting evolving mission needs.
|
||||
|
||||
CCP_00189-Percent of languages in the civilian NSA Language Reserve Program (LRP), as identified for operational or potential surge requirements, with a capability of three or more analysts.
|
||||
Projects: Linguists/Translators
|
||||
|
||||
| Fiscal Year | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 |
|
||||
| :---------- | :--- | :--- | :--- | :--------- | :----------- | :--- |
|
||||
| Funding | | | | $228.1 | Discontinued | |
|
||||
| Target | | | | 34 | Discontinued | |
|
||||
| Result | | | | 28 | Discontinued | |
|
||||
|
||||
Results: In FY 2011, the target was not met due to the high operations tempo, which resulted in mission personnel being unavailable to attend scheduled training classes. This measure is discontinued effective FY 2012 and replaced by a new measure, AP 00030.
|
||||
|
||||
262
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
58
data/black-budget-262/metadata.json
Normal file
58
data/black-budget-262/metadata.json
Normal file
|
|
@ -0,0 +1,58 @@
|
|||
{
|
||||
"title": "“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, p. 262 (February 2012)",
|
||||
"type": "REPORTED",
|
||||
"description": "This excerpt from the Fiscal Year 2013 Congressional Budget Justification (the \"Black Budget\") details the NSA's financial and performance metrics for \"Analytics Modernization,\" specifically focusing on the transition to high-volume, automated speech-to-text systems. It records the decommissioning of legacy voice processing systems (VoiceRT) in favor of more robust, scalable capabilities aimed at rendering millions of intercepted voice files searchable via text queries and paired dialogue transcription.",
|
||||
"long_description": "The document provides a rare financial window into the industrialization of the NSA’s \"bulk listening\" capabilities. A primary metric, labeled CCP_00083, tracks the number of voice files rendered searchable by text queries. While the agency missed its FY 2011 target of 350,000 files—finishing at approximately 285,337—the failure is attributed to a strategic transition. The NSA decommissioned VoiceRT systems outside of Washington to prepare for SPIRITFIRE, a more advanced voice analytic system operationalized by 2013 that focuses on automated keyword searching and full dialogue transcription.\n\nFinancially, the \"Analytics Modernization\" project received significant backing, with funding peaking at $512.5 million in FY 2012. A key efficiency metric, CCP_00103, shows the agency’s success in drastically lowering the \"average cost to deliver an analytic hour equivalent.\" By leveraging machine translation (MT) and automated speech recognition (ASR), the NSA reduced the cost per analytic hour from $1.12 in 2008 to a projected $0.21 by 2013. This shift signifies a move away from expensive human linguistics toward a high-speed, machine-driven SIGINT enterprise.\n\nThe budget also highlights infrastructure and human capital challenges. Project CCP_00169 details the struggle to establish a massive \"enterprise distributed database architecture\" for content storage, which faced delays due to engineering changes and facility leasing issues. Additionally, metrics for the Linguists/Translators project (CCP_00179) show that while the number of analysts trained in Digital Network Intelligence (DNI) increased, high attrition rates and an intense \"operations tempo\" hindered the agency from reaching its full training benchmarks. This emphasizes that even as the NSA pivots toward automation, the demand for specialized human analysts to oversee these \"Black Budget\" systems remains a bottleneck.",
|
||||
"tags": [
|
||||
"Black Budget",
|
||||
"analytic modernization",
|
||||
"speech-to-text",
|
||||
"speech recognition",
|
||||
"machine translation",
|
||||
"congressional budget",
|
||||
"voice intercept",
|
||||
"keyword search",
|
||||
"dialogue transcription",
|
||||
"Human Language Technology",
|
||||
"automated surveillance",
|
||||
"linguistics",
|
||||
"language"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "2012-02-01",
|
||||
"classification": [
|
||||
"TOP SECRET",
|
||||
"SI",
|
||||
"TK"
|
||||
],
|
||||
"dissemination": [
|
||||
"NOFORN"
|
||||
],
|
||||
"banner": "TOP SECRET//SI/TK//NOFORN",
|
||||
"genre": "other",
|
||||
"programs": [
|
||||
"VoiceRT"
|
||||
],
|
||||
"countries": [],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Intercept",
|
||||
"date_published": "2015-05-05",
|
||||
"title": "How the NSA Converts Spoken Words Into Searchable Text",
|
||||
"link": "https://theintercept.com/2015/05/05/nsa-speech-recognition-snowden-searchable-text/",
|
||||
"reporters": [
|
||||
"Froomkin, Dan"
|
||||
],
|
||||
"contributors": [
|
||||
"Fishman, Andrew"
|
||||
],
|
||||
"doc_source": "https://theintercept.com/document/2015/05/05/black-budget-fy-2013-congressional-budget-justificationnational-intelligence-program-p-262/",
|
||||
"doc_url": "https://s3.documentcloud.org/documents/2072013/black-budget-262.pdf"
|
||||
}
|
||||
],
|
||||
"pdf_sha256": "73701e5015a3c7e27951ba5f9d3748a756c25143b8c7aaa3e62c5037ba1b24b5",
|
||||
"pages": 1
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue