Apple Patent for Mixed Camera/Pixel Display
Sometimes I really hope Apple comes out with some of the things they file at the US Patent Office. One such example is this crazy cool "integrated sensing display" with mixed pixels and miniature cameras. [warning: patent images best viewed with Safari]
In the patent filing itself, Apple denotes various ways imaging sensors could be embedded into a display, including the example I chose described as follows:
"Integrating image capture devices into the displays can be done with varying degrees of intrusiveness, depending upon the type of display. FIG. 3A depicts an exemplary "track" housing scheme of integrating image elements 305 into a deep encased cell structure display 300 according to one embodiment of the invention. Each image element 305 is integrated into black strips 310, so that the spaces in-between each color cell 315 and 320 are used for both contrast enhancement and image capture."
This display looks as though its final function would be similar to a sort of scanner or large CMOS or CCD, as well as be able to display images. Imagine being able to stick the display of your PDA on a surface and have the image of said surface (which then would be flipped from the mirror effect) displayed right on your screen. Why would this be more interesting than just having a webcam integrated into a laptop? Well for one, you would have a larger sensing field. Secondly a webcam is usually at the top of your screen, making it semi-annoying to carry on a video conversation with someone on the screen.
Some other applications of arrays of cameras include after-the-fact virtual camera motion and time dilation (think Wachowski brothers and technologies invented for the Matrix). I'm not sure this Apple patent will be of a high enough resolution for these applications, but perhaps some inkling of virtual camera ability from the array will be integrated.
I don't know if Apple will ever use this patented technology, but I sure hope they do. Feel free to participate in rumor mongering in the comments.
[via the Mac Observer] [camera array from Stanford via Hack-A-Day Siggraph coverage]
![TUAW [Cafepress]](http://www.blogsmithmedia.com/www.tuaw.com/media/tuaw-cafepress-promo.png)
Reader Comments (Page 1 of 1)
Mikek said 9:03AM on 1-26-2006
PDA yeah thats cool, but this how scifi camouflage is always described. Very Cool. Take care --Mike
Reply
Shig the Unmentionable said 9:37AM on 1-26-2006
Yakov Smirnov's career is spinning in its grave. "In America, always you are watching television. In Russia, television watch YOU!"
Reply
Mike G said 10:14AM on 1-26-2006
You could use it to track something moving across a screen which had a rigid surface - like tablet PC's - but with the benefit of being able to use any object such your finger - like you can with the touch screen on a PDA - instead of just the pen that comes with the tablet.
Where's my MacTouch Pro?
Reply
Jason said 10:41AM on 1-26-2006
Did this remind anyone else of 1984, where the TV was monitoring you?
Reply
Reid Ellis said 11:01AM on 1-26-2006
It might be a lot easier (and cheaper!) to stick fibre-optic threads amongst the pixels and then gather all the light from the fibers to the lens of a standard CCD somewhere.
Reply
Victor Agreda, Jr. said 11:22AM on 1-26-2006
I think this was intended to be in iPods. There have been rumors about an Apple camera for a while (never mind the old Apple cameras, so there is a lineage there)... Think about an iPod you can point at people (or yourself) and record? For vodcasts this would be brilliant. Set the iPod at an angle facing you, and you have a self-monitoring vodcasting station. Now they only need to squeeze GarageBand in there, WiFi or EVDO, and you literally have a studio in your pocket. Gogo crazy rumors!
Reply
John said 11:24AM on 1-26-2006
There was an Apple video back in the early 90's that showed a man sitting on a park bench learning to read using a Knowledge Navigator. After he and the computer had finished his lesson, he asked the computer if he could try a newspaper article. He then placed the newspaper flat onto the computer display, it was scanned, and then he and the computer began reading it out loud on the screen. Now if we could only figure out the folding screen....
Reply
Bob said 11:59AM on 1-26-2006
You are all forgetting the best use. The Star Trek screen. Ever notice how they're looking right at the screen image of the person they're talking to and that person sees them looking right at them. There's no parallax at all from the differing angles of screen to camera, so the screen itself must be the camera!
First, the department of defense invents transparent aluminum. Now Apple invents the star trek viewscreen. Who gets to invent Warp Drive?
Bob
Reply
Carl Trimble said 2:28PM on 1-26-2006
How about an iPod that can take pictures as well as play video? Simplicity at its best. If this really happens mac world expo will turn into a magic show!
Reply
Eric E said 5:16PM on 1-26-2006
Heres what I think
First, lets not forget that some companies file patents for the sole puropose of spooking their competitors (and in apple's case, us) on occasion. When I think of companies who would possibly engage in this activity, Apple is at the top of my list.
For much of the patent application, the applicant speculates on the possibilities and various embodiments of the invention. This could be for one of two reasons: 1) they want to avoid any sticky legal situations and 2) they are playing with us. I can't help but think its the latter. There's even a good bit of Apple charm loaded in the text; "those skilled in the art..." I don't think it's wrong for Apple to be doing this and it's not just to entertain themselves, it's a fine example of creative commentary and could help spur creative thinking within apple and the design and engineering community.
Note that there are exactly 20 claims. Apple could have added more claims for an additional fee, but I think they were just trying to use up the first 20.
When the Macbook Pro was unveiled, my first reaction was disgust. The new features looked very rushed (besides the new power connector) and not true to apple's high standards of design and constant innovation. Two important points here: the integrated isight and the ir sensor for the remote. The isight at the top of the screen ruins one of the most defining features of the powerbook - it's thin lcd frame. It's one of the marks of the powerbook; you could recognize a powerbook from yards away just by the uniformity of the screen's frame. No other notebook on the market has a uniform frame like the powerbook's, and I was very disappointed to see it go. Also, the remote sensor looks like they just decided to drill a hole in the case and slap it in. With further design, they could have put it on the same chip as the white sleep indicator led built into the screen clasp/button thing.
I'm sure Apple had gone to great lengths to not resort to widening the frame on the screen, and I think I even heard talk that it just wanst possible to fit anything else inside the powerbook bezel. Looks like Apple was as unhappy about the situation as I am. Maybe the camera thing is for real and they're just beginning research.
I also wouldn't be surprised if Apple wanted to use this to make "super" displays that can correct the image across the entire display in response to the lighting in the room and provide calibrational feedback. Don't forget that Apple's displays are some of the best ones on the market when it comes to calibration and accuracy, which makes them popular among professionals in the imaging, video, and design industries.
Reply
PeterMengO said 3:33PM on 1-30-2006
Speaking of the Knowledge Navigator hideos does anyone have copies of them. I have a .MOV of the first and original one, but I know there were at least three additional vidoes. One on portability, another on medicine, and a 3rd on solutions for physically and mentally disabled.
Reply