Filed under: iPhone, App Review
Digit-Eyes identfies everything for the blind without breaking the bank
The Digit-Eyes Audio Scanner and Labeler (US$29.95) from Digital Miracles is a remarkable Assistive Technology (AT) app for the iPhone The app does three things. The first and simplest is, using the built in camera, scanning UPC and EAN codes found on most everything. Taking advantage of the VoiceOver accessibility capability built into the iPhone
The second thing it does, is more compelling. Once you register for a free account on their site, you can create text labels for printing on over 50 sizes of standard Avery labels. Select a type of label and a template page is displayed full of empty boxes representing labels. In each box, type in up to 100 characters of anything you want the label to say.
Once done, all your text is transformed into a .pdf page of QR (quick recognition) codes like the one shown in the upper right corner of this post. Print the page on the Avery label stock, and stick each on whatever you wanted the label to say. For example, if you typed in "Blueberries bought on July 31st", you would stick that corresponding label on a container of blueberries. Then using the Digit-Eyes app, scan the label on the container and the screen will display and a voice will read back "Digit-Eyes label read: Blueberries bought on July 31st". The database of what's behind each label is stored on your iPhone so you won't need an Internet connection to access the information.
Gallery: Digital-Eyes
The third capability of Digit-Eyes is even better. Go to the site and print out a page of audio labels on the same Avery Labels and stick each one on something. The labels are empty, but serialized so each label has a unique number associated with it. Using Digit-Eyes, scan the label (when scanning you hear a tick every few seconds to tell you it's working and another sound when the scan is done) and the iPhone will display a screen with a Record button on it. Tap the button and speak whatever text you would like to have associated with the label. You can speak for as long as you like. Once done, tap the Stop Recording button and you'll see a brief screen saying Finalizing, while the app processes the audio file.
In a moment you'll hear your voice reading back what you spoke with a button allowing you to Stop Playback. After the sound file is played, Stop Playback becomes Scan which is displayed along with two other buttons marked Delete and Re-Record. If you liked what you heard, do nothing, but you are also given the options re-scanning, which erases the sound file and lets you start over and re-scans the label, deleting the connection of sound and label so the label can later be re-used, or re-record the voice memo that will be connected to the label. The next time you scan the label the recording will be read to you. All audio is stored on your device, so again you need no Internet connection. Everything is backed up when you sync, so if your iPhone breaks or gets lost, restoring on a new one will put everything right.
This may all sound rather complicated, but it's really not once you get the hang of just what's going on. The text labels when printed are already filled with content that you input, while the audio labels are empty but serialized, waiting for you to scan one and attach a voice memo to it that will be read back anytime the label is re-scanned.
I didn't get the idea at first, and had long conversations with Nancy Miracle, the president of Digital Miracles (with a name like Miracle, you just have to use it), about improving the extensive tutorial found on the Digit-Eyes site from an Instructional design perspective. It's been re-written just about from top to bottom and I think it's now extremely clear. What you need to understand is that Digit-Eyes is not an app that you can be productive with as soon as it's downloaded. it will take around 20 minutes of reading and practicing before the curtains are drawn and you realize what an achievement it is, and how wonderfully useful this can be for the blind or visually impaired.
So what can you do with it? There are many ideas to be found on the site but they just scratch the surface since you can really do anything that will assist the blind with identifying objects. Put some labels on cans, that all feel the same, and it will prevent you from opening a can of dog food when you really want peas. Differentiate between bottles of wine. Take some audio labels to the drug store and when the pharmacist explains the three different bottles of prescription pills, record an audio label detailing what the pill is and the dosage instructions and stick each on the corresponding bottle. Most pill bottles feels the same as do many pills, and I've never seen a UPC code on a prescription label. Put a label on all the doors at your place of work and you'll never knock on the wrong door again. Play the first few seconds of a CD since you've already mixed up the CD cases, record a label and put it on the jewel box while telling yourself to be more careful in the future. I can go on, but I think you get the picture.
The pricing needs to be addressed. There is a lite version for free which doesn't allow you to make audio labels or scan UPC/EAN codes, but does let you print and scan text labels. However, I think the real value is in the audio labels and that will cost you $29.95 at least until the end of September when the price may go up. Just like Proloquo2Go, the competition is stand alone uni-functional devices. An example of such a device is the ID Mate Summit which costs $1299. This uses an actual red laser to scan UPC/EAN codes. You wear it around your neck, which is far more intrusive than having an iPhone in your pocket, and you can scan codes that are read to you. There is also the ability to add voice memos to the codes that are stored on a SD card. The database for the Summit is more extensive and gives a lot more information than provided by Digital-Eyes by scanning. It also does a few more tricks, but it costs $1269.05 more. For a lot less money you can get the non-portable Metrologic Scanner for $299. This standalone scanner needs to be tethered via USB to a Windows computer that already has screen reading software installed. Probably the most popular software is JAWS, at a cost of $895.
But what if you want screen reading capabilities on another smartphone? You can add voice to phones running the Windows or Symbian OS for $295 by buying Mobile Speak, and that doesn't include scanning software. There are a number of free screen readers for Google's Android OS, but there is no standardization of gestures and many of the products are considered by the blind to be inaccessible. The iPhone is the most reasonable platform. According to Nancy Miracle, the fact that Apple has integrated VoiceOver into the phone, that VoiceOver uses common gestures across all platforms, and that VoiceOver comes at no extra charge are all huge advantages. She said that if she were selling iPhones instead of software at various AT conventions she would have made a fortune.
Digit-Eyes, by leveraging the power of VoiceOver, offers the blind and visually impaired a truckload of functionality for a price that's laughingly cheap. Instead of just being an app, it's a total system incorporating labels printed from the web site and scanned on the iPhone, giving users a total solution to an unfathomable number of problems. It does this in an non-intrusive manner that doesn't require the blind to carry or wear a device that broadcasts that they are visually impaired. Digit-Eyes is just one of an ever increasing list of AT apps that prove, once again, that the iPhone is the best mobile device on the market for the Assistive Technology community.
TUAW is commonly provided with not-for-resale licenses or promo codes to permit product evaluations and reviews. For more details, see our policy page.



![TUAW [Cafepress]](http://www.blogsmithmedia.com/www.tuaw.com/media/tuaw-cafepress-promo.png)


Reader Comments (Page 1 of 1)
Evan said 3:27PM on 7-31-2010
If the dictation went to a server, this would be a great way for EMS to be able to dictate a patient care report by scanning a barcode on their paper record.
Reply
Abcmsaj said 2:42PM on 7-31-2010
As for the QR tag, I didn't d/l Digit-Eyes... I used a free QR reader from the app store :)
Reply
Rego said 3:08PM on 7-31-2010
Sounds like a great app; but the iPod Touch doesn't have a camera yet?
Reply
David Winograd said 3:22PM on 7-31-2010
Yikes! You're right. Changing it now.
jak Tiano said 5:24PM on 7-31-2010
Is this a sign? Are you from the FUTURE? HAVE YOU SEEN A WORKING PROTOTYPE?!
Or maybe it's just a typo. Meh.
Gene Cowan said 6:35PM on 7-31-2010
Wait, I don't understand -- it is difficult enough for a sighted person to aim and focus the iPhone camera at a barcode, are you saying that the makers of this app expect a blind person to find a barcode on a package, aim their camera, and take a picture of it?
Then the blind user is supposed to pick from a page "full of empty boxes" and type in a label?
Reply
Nancy Miracle said 7:17PM on 7-31-2010
Hi Gene,
In response to your question, yes, we do expect a blind person to be able to use the camera on the iPhone and capture the bar code. And in fact, it works extremely well.
The reason is that we aren't doing quite what you are thinking.
We don't expect the blind person to line up and take a snap shot of a bar code, but instead, activate the iPhone camera to take digital video. We then mathematically analyze each frame out of the digital video stream to find the codes. Furthermore, because the mathematical approach to analyzing the image is different, Digit-Eyes is insensitive to skew and (relatively) insensitive to parallax issues unlike Red Laser (where the user has to line the code up in a box -- obviously not a feasible operation for someone who is not sighted).
Bar codes are located in fairly predictible places -- such as opposite the opening end of a box or where the labels join on a can.
We have found that if we start by holding the camera close to the surface of the box or jar or can where the label is expected and simply move the camera away slowly that by the time the camera is 12 inches or so away from the article, our technology will recognize the bar code.
If you have used Red Laser or a similar product, you will be astounded about how differently (and how much better) Digit-Eyes works.
In terms of how the user picks from a page of empty boxes, the Digit-Eyes website actually has several different appearances, depending on whether the visitor is sighted, using a style-independent zoom utility or a text-to-speech browser such as jaws or Window-Eyes.
The term 'page full of empty boxes' is how the input page for text labels appears to a sighted person using a conventional graphical browser. The organization of the input boxes is obvious and no labels are needed.
For the person who is not sighted and reading our web site using a text-to-speech browser, the boxes are labeled so that the organization is obvious
'Row 1, column 1'
'Row 1, column 2'
'Row 2, column 1'
'Row 2, column 2'
'Row 3, column 1'
'Row 3, column 2'
Whether you are sighted or not, please feel free to visit our website http://www.digit-eyes.com, download the free version of the product from the app store http://itunes.apple.com/us/app/digit-eyes-lite-audio-labeler/id379865944?mt=8 and try it out!
Cordially,
Nancy Miracle
Reply
Gene Cowan said 12:02PM on 8-01-2010
Ah, this makes much more sense. Thanks for the clarification.
Taking a video then processing it is a brilliant move that didn't even occur to me!
I've tried out the iPhone's accessibility options and they do take quite a bit more time to get the simplest things done -- but it does work, and I can only assume that with time and practice one could probably zip through the interface pretty quickly.
James Jolley said 7:23PM on 7-31-2010
Having just used the app for a little while, I can say that it works fine. I'm totally blind and have successfully used the app to look up barcodes for various items. I don't have the iPhone 4 but the 3Gs works perfectly fine for this. Generally, the codes are easy enough to find, the system seems to automate the OCR side on its own by clicking and taking pictures i'm assuming. It's certainly very useful and i'm sure i'll get better at it with practice.
Reply
Farris said 8:48PM on 7-31-2010
Forgive me if this comes across as insensitive, but how are blind users supposed to use a button-free phone?
Reply
Roger said 9:01PM on 7-31-2010
Sincere inquiries are never insensitive, I should think, and the answer is VoiceOver, which reads everything on the screen, including which on-screen button your finger is currently on.
Nancy Miracle said 9:36AM on 8-01-2010
The iPhone works amazingly well if you are not sighted! If you'd like to experience how it works and you have a 3GS or version 4 iPhone, do the following:
On your phone, select: Settings -> General -> Accessibility -> VoiceOver -> toggle on
Stop and read! Maybe even click the link that explains the VoiceOver gestures -- they are different than the standard ones on the iPhone. You'll be activating links by tapping them twice or by having one finger on them and then tapping with another finger someplace else on the screen.
Click the home key at the bottom of the phone to return to your main page.
Now, with three fingers, tap three times. This gesture turns off the display of icons on the screen and is called the 'screen curtain'. Many people who are blind run their iPhone in this mode because doing so gives privacy and saves a bit of battery.
Even though the screen now appears blank, all the icons are still there, as is the full functionality of the phone. Run your finger over the screen and you'll know what is where because the icons will be announced by VoiceOver. To execute a program, tap twice on any icon or keep one finger on the icon you want and then tap with another finger someplace else on the screen.
When you want to return to your usual display, tap three times with three fingers again to deactivate the screen curtain.
To turn Voiceover off, tap twice on 'settings' and then twice on the VoiceOver 'on/off' slider (under ios4, the 'settings' task is just suspended and you'll return to the VoiceOver option). If you need to find VoiceOver again, just use the same path you used above, but tap each button twice.
Roger said 9:00PM on 7-31-2010
A very interesting article, thanks David.
Minor correction: typo in the headline: identfies should be identifies. No worries.
This is the kind of use of technology that should be promoted to the ends of the Earth. I haven't looked to see if digit-eyes is only available for the iPhone, but I hope it isn't, or will be developed for other platforms. I know that other phones have cameras, of course, but I have no idea what the accessibility options are on other phones, or of what quality they are. How does the iPhone stack up in that regard compared to other phones? Is something like VoiceOver present?
All in all, it's fantastic that technology is being leveraged to help the impaired like this. I'd much rather see the tech being used for this than another "my friend is so drunk" video.
Reply
David Winograd said 1:08PM on 8-01-2010
If you read the end of the article it talks about how no other phone offers anything like VoiceOver for free. So the beauty part is that most of the heavy lifting is already being done by Apple.
I don't think there's any chance of it appearing on any other phone
Roger said 1:21PM on 8-01-2010
Thanks for the reply, David.
I did read the bit at the end about Mobile Speak and the Android options. What I was wondering was if that was it. There could be other options out there not mentioned.
I applaud Apple for developing the underlying enabling technology as a part of the OS, rather than as a separate function at additional cost. The development expenses must have cost Apple a tidy sum, with little more in return than a small fraction of total iPhone sales. Good on them for doing it anyway. Another reason I like Apple.
David Winograd said 2:12AM on 8-02-2010
Roger,
The other options I found are even more expensive. For comparison purposes I used the cheapest solution I could find. If Digit-Eyes were to be made for any other smartphone the total cost would be at least $350 and maybe even more.
Reply