Speech Analysis

Emotion detection using speech analysis by Nemesysco

Speech Analysis - Emotion detection using speech analysis by Nemesysco

Isolated populations emotional monitoring

Using Nemesysco’s voice analysis for Emotional state monitoring of isolated populations

People in isolated facilities (prisons, distant working locations, army bases, ships etc…) are exposed to many different types of events and forces that have a severe impact on their emotional state, and may drive them to extreme actions, harming others or themselves. In open facilities, the effect of such emotional charge may be dissolved by detachment from the group, a friendly companion or a pleasurable act. However, the isolated facility offers very limited possibilities for extreme emotions to be dissolved, and in fact increasing the need for immediate identification and affirmative action by local supervisors.

The emotional changing forces include external influences such as other inmates or peers acts and disregards, conversations with remote parties and management level attention. Additionally, internal forces develop over time out of memories and new sets of personal expectations not necessarily related to external effects.

Monitoring internal verbal communication among the isolated population, as well as monitoring their communication with the external world using voice analysis may provide important indications about the person’s state of mind, and allow proper attention and treatment. Additionally, the system can provide some predictive value to near-future actions – and assist the prevention of self-harm, suicide and assault on others.

Few challenges are easily identified:

  1. The collection of the relevant voice data may not be trivial, simply because some people just don’t communicate much with others
  2. Some events may be planned and carried out in a short time frame and with no audio data containing relevant signals (no recorded session is available following the “action decision”)
  3. Action by proxy – Some events may be planned by one but carried out by others – and so pinpointing the individual making a decision may not be enough

Despite those limitations, voice monitoring system can provide useful data for decision makers and treatment managers and will even perform much better if connected to additional sources of information. Integration with other evaluation systems, databases containing past emotional records (thus helping to observe trend development and critical changes) and inner-group connections map (that may help to identify different roles and relationships) will enhance the system’s capabilities dramatically.

Using Nemesysco’s security level voice analysis technology, voice data from any source and /or communication system (such as internal and external phone system) is automatically processed and associated with the relevant person. Databases can be updated with new emotional data and predictive algorithms are then used to identify critical change and issue a warning immediately. Trend analysis is used to identify a problematic trend development over time, and unique emotional cues can be associated with different relationships between the individuals and the outside world.

Using certain emotional parameters it will be easier to identify communication containing key-words, action commands and other illegal activities, and assist the work of the intelligence officers in the relevant facilities.

The unique abilities of Nemesysco’s LVA technology can assess many different emotional components such as stress, anger, positive and negative emotional reactions, concentration, anticipation and much more, thereby creating very profound datasets for advanced analysis.

* Nemesysco is currently in first field tests of SCA1 based emotional state analysis system for inmates in the USA