Real and virtual explorations of the environment and interactive tracking of movable objects for the blind on the basis of tactile-acoustical maps and 3D environment models

Disability and Rehabilitation. Assistive Technology
Andreas HubThomas Ertl

Abstract

PURPOSE.: This study describes the development of a multi-functional assistant system for the blind which combines localisation, real and virtual navigation within modelled environments and the identification and tracking of fixed and movable objects. The approximate position of buildings is determined with a global positioning sensor (GPS), then the user establishes exact position at a specific landmark, like a door. This location initialises indoor navigation, based on an inertial sensor, a step recognition algorithm and map. Tracking of movable objects is provided by another inertial sensor and a head-mounted stereo camera, combined with 3D environmental models. This study developed an algorithm based on shape and colour to identify objects and used a common face detection algorithm to inform the user of the presence and position of others. The system allows blind people to determine their position with approximately 1 metre accuracy. Virtual exploration of the environment can be accomplished by moving one's finger on a touch screen of a small portable tablet PC. The name of rooms, building features and hazards, modelled objects and their positions are presented acoustically or in Braille. Given adequate environmental models...Continue Reading

Citations

Dec 20, 2015·Wiley Interdisciplinary Reviews. Cognitive Science·Victor R SchinaziDaniel-Robert Chebat
May 27, 2014·Frontiers in Human Neuroscience·Vincent K LeeChris Fisher
Jan 3, 2015·The American Journal of Occupational Therapy : Official Publication of the American Occupational Therapy Association·Amy C NauChristopher Fisher

❮ Previous
Next ❯

Related Concepts

Related Feeds

Aphasia

Aphasia affects the ability to process language, including formulation and comprehension of language and speech, as well as the ability to read or write. Here is the latest research on aphasia.

Related Papers

Cirugia y cirujanos
Gilberto Bernal-SánchezCarlos Otero-Meza
Medical Image Computing and Computer-assisted Intervention : MICCAI
Fanhuai ShiZijian Zhao
Biomedizinische Technik. Biomedical Engineering
Pier Paolo MonticoneMartin Schlup
© 2022 Meta ULC. All rights reserved