first commit
This commit is contained in:
commit
0d90363116
6510 changed files with 679146 additions and 0 deletions
104
data/black-budget-360-364/black-budget-360-364.md
Normal file
104
data/black-budget-360-364/black-budget-360-364.md
Normal file
|
|
@ -0,0 +1,104 @@
|
|||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
THIS PAGE INTENTIONALLY LEFT BLANK
|
||||
|
||||
360
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
(U) RESEARCH & TECHNOLOGY
|
||||
(U) HUMAN LANGUAGE TECHNOLOGY RESEARCH
|
||||
|
||||
This Exhibit is SECRET//NOFORN
|
||||
| | FY 2011¹ Actual | FY 2012 Enacted | | | FY 2013 Request | | | FY 2012 — | FY 2013 |
|
||||
| :----------------- | :-------------- | :-------------- | :-- | :---- | :-------------- | :-- | :---- | :-------- | :------- |
|
||||
| | | Base | OCO | Total | Base | OCO | Total | Change | % Change |
|
||||
| Funding ($M) | 26.4 | 31.0 | 3.0 | 34.0 | 26.0 | 3.4 | 29.4 | -4.7 | -14 |
|
||||
| Civilian FTE | 8 | 8 | | 8 | 8 | | 8 | | |
|
||||
| Civilian Positions | 8 | 8 | | 8 | 8 | | 8 | | |
|
||||
| Military Positions | — | — | | — | — | | — | | |
|
||||
|
||||
¹ Includes enacted OCO funding.
|
||||
Totals may not add due to rounding.
|
||||
|
||||
(U) Project Description
|
||||
|
||||
(U//FOUO) The Human Language Technology (HLT) Research Project provides a coherent, concentrated focus on language analytics to exploit the volume, variety, and velocity of communications that the SIGINT system collects. HLT Research conducts research that supports the goals of the NSA/CSS' Analytic Modernization effort. This Project complements NSA/CSS initiatives to strengthen the language analyst workforce by providing the technologies that serve as force multipliers for analysts.
|
||||
|
||||
(U//FOUO) The HLT Research Project has an HLT Center of Excellence (COE) at Johns Hopkins University to promote academic and industry interest in intelligence challenges and attract world-class talent to work on IC HLT problems. The HLT COE focuses on critical intelligence needs that are not adequately addressed by commercial technology or other government programs. The HLT Research Project also leverages programs at the Defense Advanced Research Projects Agency (DARPA) and the Intelligence Advanced Research Projects Activity (IARPA). DARPA and IARPA programs provide foundational HLT capabilities in automatic content extraction, speech-to-text, machine translation, summarization, and question answering. The HLT Research Project conducts research and advanced development necessary to bridge research results from DARPA's and IARPA's efforts to SIGINT applications. This Project includes the Human Language Technology Research Sub-Project.
|
||||
|
||||
(U) Base resources in this project are used to:
|
||||
|
||||
* (S//SI//REL TO USA, FVEY) Research and develop voice, text, video and image analytics to enable fundamental language exploitation capabilities for all types of communication, regardless of medium.
|
||||
* (S//SI//REL TO USA, FVEY) Increase the number of languages, accuracy, and speed of results for keyword search from machine-generated transformations of speech-to-text.
|
||||
* (S//SI//REL TO USA, FVEY) Conduct research and advanced development on automatic document image analysis, particularly for handwritten documents, an extreme technical challenge. The primary emphasis is on core capabilities to enable triage and keyword search on the diverse kinds of documents found in intercept, including language and script identification and handwritten document detection, segmentation, and analysis.
|
||||
* (U//FOUO) Research analytics that automatically analyze the linguistic content of communications. This area comprises several technologies, including content extraction and machine translation. Content analytics identifies and extracts information from language communications, turning a mass of unstructured text into usable metadata.
|
||||
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
361
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
* (TS//SI//REL TO USA, FVEY) Research, design, and develop analytics that enable deployment of HLT capabilities nearer to the point of collection within the SIGINT system.
|
||||
* (U//FOUO) Support collaborative research into human language exploitation and machine learning with commercial and academic partners.
|
||||
* (U//FOUO) Develop test and training data to support scientific research and evaluation.
|
||||
* (U//FOUO) Provide and maintain a computer lab to support in-house algorithm development, evaluation, and proof-of-concept demonstrations of promising solutions.
|
||||
* (U//FOUO) Sustain support activities that foster cross-organizational and cross-discipline collaboration in solving hard technical problems critical to the success of NSA/CSS' SIGINT and cyber missions as well technical health of the workforce.
|
||||
|
||||
(U) There are no new activities in this Project in FY 2013.
|
||||
|
||||
(U) OCO resources in this project are used to:
|
||||
|
||||
* (TS//SI//REL TO USA, FVEY) Enable machine translation research and new speech processing capabilities for Afghanistan and Pakistan dialects using state-of-the-art research findings in less-common languages and by developing new language and dialect models.
|
||||
|
||||
(U) The CCP expects this Project to accomplish the following in FY 2013:
|
||||
|
||||
* (S//REL TO USA, FVEY) Develop and deploy speech-to-text models for additional languages, where the languages will be selected according to corporate NSA/CSS priorities, language analyst preparation, and scientific assessment of technology readiness. [CCP_0106]
|
||||
* (S//REL TO USA, FVEY) Extend name-finding solutions to support named-entity extraction for 12 additional languages, to include at least three languages that are less-commonly taught. Create and demonstrate solutions in three to five languages for the much harder problem of extracting relations between entities. These capabilities will yield automated solutions to uncover pertinent facts within both unstructured written communications and spoken communications that have been transformed into text. [CCP_0106]
|
||||
* (U//FOUO) Design techniques to reduce by 25 percent hand-annotated data required to develop models in support of speech-to-text solutions. [CCP_0106]
|
||||
* (S//REL TO USA, FVEY) Research, develop, and demonstrate solutions for cross-lingual entity disambiguation to enable analysts to perform language independent retrieval of communications to, from, or about persons of interest from multi-lingual SIGINT data sets. [CCP_0106]
|
||||
|
||||
(U) Changes From FY 2012 to FY 2013:
|
||||
|
||||
(S//NF) Human Language Technology Research: -$4.7 million (-$5.1 Base, +$0.4 OCO). The aggregate decrease is the result of:
|
||||
|
||||
* (U) Increases:
|
||||
* (S//NF) $0.4 million in Overseas Contingency Operations (OCO) accelerates new speech processing capabilities and associated analyst applications for Afghanistan and Pakistan dialects.
|
||||
|
||||
362
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
* (U) Decreases:
|
||||
* (S//NF) $5.0 million due to a FY 2012 Congressional add not sustained in FY 2013.
|
||||
* (S//NF) $0.1 million due to a planned programmatic reduction in travel and training.
|
||||
|
||||
Human Language Technology Research Project Budget Chart
|
||||
FY 2013 Budget Request by Appropriation Account
|
||||
This Exhibit is SECRET//NOFORN
|
||||
|
||||
| Subproject | Description | Resourcing | Funds FY 2011 | FY 2012 | Funds FY 2013 |
|
||||
| :-------------------------------------------------------- | :--------------------------- | :--------- | :------------ | :------ | :------------ |
|
||||
| Operation and Maintenance, Defense-Wide | | Funds | | | 1.12 |
|
||||
| | | Positions | | | 8 |
|
||||
| Human Language Technology Research | Pay and Benefits | Base | | | 1.12 |
|
||||
| | | Positions | | | 8 |
|
||||
| Research, Development, Test, and Evaluation, Defense-Wide | | Funds | 26.36 | 34.03 | 28.23 |
|
||||
| | | Positions | 8 | 8 | |
|
||||
| | Communications and Utilities | Base | 0.06 | 0.04 | 0.04 |
|
||||
| | Contract Services | Base | 24.35 | 28.07 | 23.36 |
|
||||
| | | OCO | — | 3.00 | 3.40 |
|
||||
| Human Language Technology Research | Equipment | Base | 0.57 | 1.76 | 1.36 |
|
||||
| | Pay and Benefits | Base | 1.20 | 1.09 | — |
|
||||
| | Travel and Transportation | Base | 0.17 | 0.07 | 0.07 |
|
||||
| | | Positions | 8 | 8 | |
|
||||
|
||||
Totals may not add due to rounding.
|
||||
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
363
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
|
||||
THIS PAGE INTENTIONALLY LEFT BLANK
|
||||
|
||||
364
|
||||
TOP SECRET//SI/TK//NOFORN
|
||||
58
data/black-budget-360-364/metadata.json
Normal file
58
data/black-budget-360-364/metadata.json
Normal file
|
|
@ -0,0 +1,58 @@
|
|||
{
|
||||
"title": "“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, pp. 360-364 (February 2012)",
|
||||
"type": "REPORTED",
|
||||
"description": "The \"Human Language Technology (HLT) Research\" section of the FY 2013 \"Black Budget\" details a specialized research project focused on creating \"force multipliers\" for the NSA workforce through automated speech-to-text, machine translation, and content extraction. With a requested budget of $29.4 million, the project aims to bridge the gap between foundational academic research (via Johns Hopkins University) and the practical exploitation of the volume and velocity of global SIGINT.",
|
||||
"long_description": "The HLT Research Project serves as the R&D engine for the NSA’s broader \"Analytic Modernization\" effort, focusing on the automated conversion of unstructured audio and text into searchable metadata. A primary objective outlined for FY 2013 is the expansion of speech-to-text (STT) models into new, high-priority languages, while simultaneously improving the accuracy and speed of results. To support this, the agency is researching machine learning techniques to reduce the amount of \"hand-annotated data\" required to build these models by 25 percent—a critical move to accelerate the deployment of surveillance capabilities for less-common languages and dialects.\n\nThe project’s reach extends beyond simple transcription into \"content analytics.\" This includes named-entity extraction for 12 additional languages and the pursuit of the \"much harder problem\" of relationship extraction—automatically identifying how entities (people, places, or organizations) interact within both spoken and written intercepts. A specific goal for FY 2013 is the development of \"cross-lingual entity disambiguation,\" which would allow an analyst to search for a person of interest across multi-lingual datasets, regardless of the language or script used in the original communication.\n\nStrategically, the project emphasizes moving HLT capabilities \"nearer to the point of collection\" to triage data before it even reaches a central database. While the base budget saw a $5 million reduction due to an unsustainable Congressional add, Overseas Contingency Operations (OCO) funding was increased to $3.4 million specifically to target dialects in Afghanistan and Pakistan. By leveraging partnerships with DARPA, IARPA, and a dedicated Center of Excellence at Johns Hopkins, the NSA seeks to solve \"extreme technical challenges,\" such as the automated analysis of handwritten documents and the extraction of facts from noisy, natural voice conversations.",
|
||||
"tags": [
|
||||
"Black Budget",
|
||||
"Human Language Technology",
|
||||
"analytic modernization",
|
||||
"speech-to-text",
|
||||
"machine translation",
|
||||
"content extraction",
|
||||
"linguistics",
|
||||
"language",
|
||||
"machine learning",
|
||||
"keyword search"
|
||||
],
|
||||
"document": {
|
||||
"creator": "NSA",
|
||||
"date_created": "2012-02-01",
|
||||
"classification": [
|
||||
"TOP SECRET",
|
||||
"SI",
|
||||
"TK"
|
||||
],
|
||||
"dissemination": [
|
||||
"NOFORN"
|
||||
],
|
||||
"banner": "TOP SECRET//SI/TK//NOFORN",
|
||||
"genre": "other",
|
||||
"programs": [
|
||||
"HLT"
|
||||
],
|
||||
"countries": [
|
||||
"Afghanistan",
|
||||
"Pakistan"
|
||||
],
|
||||
"people": []
|
||||
},
|
||||
"publication": [
|
||||
{
|
||||
"publisher": "The Intercept",
|
||||
"date_published": "2015-05-05",
|
||||
"title": "How the NSA Converts Spoken Words Into Searchable Text",
|
||||
"link": "https://theintercept.com/2015/05/05/nsa-speech-recognition-snowden-searchable-text/",
|
||||
"reporters": [
|
||||
"Froomkin, Dan"
|
||||
],
|
||||
"contributors": [
|
||||
"Fishman, Andrew"
|
||||
],
|
||||
"doc_source": "https://theintercept.com/document/2015/05/05/black-budget-fy-2013-congressional-budget-justificationnational-intelligence-program-pp-360-364/",
|
||||
"doc_url": "https://s3.documentcloud.org/documents/2072025/black-budget-360-364.pdf"
|
||||
}
|
||||
],
|
||||
"pdf_sha256": "d19cc161ef41a099879d9fc0a24e47a97479a1e9580f8eeeb0e68df47a448343",
|
||||
"pages": 5
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue