Annex B – Technology review
Sensory augmentation
Sensory augmentation aims at extending the
sensory range or acuity either by using gadgets/
wearables to transduce external information to the
human senses (for example, converting infrared
light to visible light) or modification of the senses
themselves. Gadgets/wearables can be used
to transduce external information to the visual,
auditory and tactile senses. Vibrations of low
magnitude from distant vehicles can be detected by
foot-mounted sensors and translated into vibrations
in the shoe or 3D audio sound that provides a directional cue. Chemical sensors detecting
improvised explosive devices can alert the soldier using any or all of audio, vision, vibration
or even olfactory displays. Navigation can be enhanced by a vibro-tactile belt that always
indicates the direction of magnetic north.^90A multimodal approach using more than one type of display type has the advantage that
information can be accessed and absorbed by more than one sensory pathway. The brain
extracts patterns of meaningful information from the sensory system, and this creates a
combined experience of simultaneous stimuli. Simultaneous presentation may decrease
mental workload and increase the chance of recognising important phenomena that would
otherwise be missed. With information filtering and enhancement, this has the potential of
improving situational awareness while reducing workload and risk of overload.Another approach is to transduce what is being sensed into a form that can be interpreted
by the human senses. Sensory remapping (turning signals into information) is already in
use. Due to the ability of the brain to adapt to new types of information (cortical plasticity),
a large set of possible inputs may be usable. Methods could include adding new
sensors/transducers and connections into the brain, perhaps also in combination with
genetic therapy. One example is coating retinal cells with nanoparticles so that light in the
infrared spectrum can be seen.^91Augmented reality
Augmented reality is a technique for displaying
different types of information in the user’s field
of view. The information is usually projected
close to the eye with the help of glasses
or helmet visor, but there are experiments
to present information in the outside world
as a hologram. With augmented reality,
the information is presented so that it is
geographically correct in real time and
symbology is used to highlight important
information. Suggested actions, as
determined by built-in artificial intelligence90 Nagel, S. K., et al., (2005), Journal of Neural Engineering, ‘Beyond sensory substitution — learning the
sixth sense’.
91 Nano week, (2019), ‘Nanotechnology makes it possible for mice to see in infrared’.