Testing OpenShades with Visually Impared UsersVictor Hernandez23/10/2013
Testing OpenShades with Visually Impared Users
(Video of the actual test) http://www.youtube.com/watc...
Two visually impaired users test OpenShades' Question-Answering and Memento (real-time annotation of scenes/objects). Prior to what is shown, they had an hour of initial testing and hadn't used Glass previously.
(Question-Answer) The user takes a picture and asks a question. These get sent to cloud workers (mechanical turk) and twitter users who answer it. The answer received is read aloud to the user through Glass. Note: the voice that you hear is what the user hears, though it is slightly muffled because it is a bone conductive speaker (best heard through headphones, captions at the bottom of the screen note important user feedback).
(Memento) A native app streams real-time video frames to a cluster, which performs image matching against a dataset of images and annotations created by a sighted user. Annotations associated with matching images are sent back to Glass and read aloud to the user.
Best viewed in 1080p HD. This is part of the http://www.openshades.com project and uses http://picar.us for online annotation and rectification. Developed and demoed by Brandyn White (http://brandynwhite.com) and Andrew Miller. The answers were provided by us for demonstration purposes. Annotation with Picarus is compatible with Mechanical Turk/Twitter.
Courtesy of Brandyn White and OpenShades project (Open Shades)