{ "title": "Innov8 Voice Analytics Experiment Profile", "type": "REPORTED", "description": "This document outlines Phase 1 of a Voice Analytics experiment conducted by GCHQ in partnership with the NSA, testing the ingestion and processing of voice data through the DISTILLERY platform on GHOSTMACHINE hardware. The experiments evaluate independent, parallel, and linked analytics (SAD, GID, LID), as well as dynamic resource management, to ensure accurate, scalable, and compliant voice processing in a Joint Collaboration Environment.", "long_description": "This document details Phase 1 of a Voice Analytics experiment conducted within the Joint Collaboration Environment (JCE) in partnership between GCHQ and the NSA. The experiment is designed to test the ingestion and processing of voice data using the DISTILLERY platform on GHOSTMACHINE hardware, a system intended to replace the older VoiceRT technology. VoiceRT provides integrated speaker ID, language ID, gender ID, DTMF detection, speech activity detection, and phonetic keyword search across more than 25 foreign languages, but it relies on specialized hardware and proprietary software. The new initiative aims to modernize this capability by running advanced voice analytics on commodity hardware, improving scalability, and leveraging updated speech-to-text and analytic algorithms from R64. The first phase of the experiment focuses on demonstrating that voice data can flow through the system at high speeds while maintaining analytic accuracy and reliability.\n\nThe experimental plan is divided into four sub-experiments, each designed to test a different aspect of the voice analytics pipeline. The first experiment evaluates independent analytic performance by running SAD, GID, and LID individually to assess accuracy and processing speed. The second experiment tests the system’s ability to run multiple analytics in parallel without data corruption. The third experiment links analytics so that outputs from one analytic inform decisions for subsequent processing, simulating real-world decision-making workflows. Finally, the fourth experiment examines dynamic resource management, where DISTILLERY spawns or removes analytic processes in response to system load and memory availability, ensuring that processing bottlenecks are avoided and resources are efficiently allocated.\n\nThe expected outcomes of these experiments include demonstrating that the JCE environment can process incoming voice data at ingest rates, scaling affordably in line with other VoIP access requirements, and filtering unwanted content while reducing storage needs. The experiments also aim to validate that voice analytics can run on commodity hardware without loss of data fidelity. Successful completion of Phase 1 will provide the foundation for subsequent phases, which may expand analytic coverage and incorporate additional voice data formats, ultimately improving operational efficiency and enabling more effective real-time analysis of voice communications.", "tags": [ "TIBCO", "Innov8", "voice analytics", "VoiceRT", "DTMF", "speech activity detection", "SAD", "phonetic keywords", "Joint Capability Activity", "JCA", "Joint Collaboration Environment", "JCE", "voice processing", "resource scaling", "VoIP" ], "document": { "creator": "GCHQ", "date_created": "2010-03-29", "classification": [ "TOP SECRET" ], "dissemination": [], "banner": "TOP SECRET", "genre": "report", "programs": [ "DISTILLERY", "VoiceRT", "GHOSTMACHINE", "MONKEYPUZZLE" ], "countries": [], "people": [] }, "publication": [ { "publisher": "The Intercept", "date_published": "2018-01-19", "title": "Finding Your Voice: Forget About Siri and Alexa — When It Comes to Voice Identification, the “NSA Reigns Supreme”", "link": "https://theintercept.com/2018/01/19/voice-recognition-technology-nsa/", "reporters": [ "Kofman, Ava" ], "contributors": [], "doc_source": "https://theintercept.com/document/2018/01/19/innov8-voiceanalytics-experiment-profile/", "doc_url": "https://s3.documentcloud.org/documents/4352010/Innov8-VoiceAnalytics-Experiment-Profile-v1-0.pdf" } ], "pdf_sha256": "c5a3f4c41e7a767c2804286566f26d7b26b3afa531c20d9b4acf6febe728d4e2", "pages": 8 }