A Pixel’s Worth a Thousand Words
By Jade Boyd
For all their ease and convenience, few devices are more wasteful and inefficient than digital cameras. They’re loaded with pricey microprocessors that chew through batteries at a breakneck pace, crunching millions of numbers per second in order to throw out as much as 99 percent of the information flowing through the lens. Now, think more efficient. Much more efficient.
That’s what a pair of engineers at Rice have done using some new mathematics and a silicon chip covered with hundreds of thousands of mirrors the size of a single bacterium. Unlike a one-megapixel camera that captures 1 million points of light for every frame, Rice’s camera creates an image by capturing just one point of light, or pixel, several thousand times in rapid succession. The new mathematics comes into play in assembling the high-resolution image—equal in quality to the one-megapixel image—from the thousands of single-pixel snapshots.
The oddest part about Rice’s camera might be that it works best when the light from the scene under view is scattered at random and turned into noise that looks like a television tuned to a dead channel. “White noise is the key,” says Richard Baraniuk, the Victor E. Cameron Professor in Electrical and Computer Engineering. “Thanks to some deep new mathematics developed just a couple of years ago, we’re able to get a useful, coherent image out of the randomly scattered measurements.”
Baraniuk’s collaborator, Kevin Kelly, assistant professor of electrical and computer engineering, built a working prototype camera using a digital micromirror device, or DMD, and a single photodiode, which turns light into electrical signals. Today’s typical retail digital camera has millions of photodiodes, or megapixels, on a single chip.
Richard Baraniuk, left, and Kevin Kelly |
DMDs, which are fabricated by Texas Instruments and used primarily in digital televisions and projectors, are capable of converting digital information to light and vice versa. Built on a microchip chassis, a DMD is covered with tiny mirrors, each about the size of a microbe, that are capable of facing only two directions. They appear bright when facing one way and dark when facing the other, so when a computer views them, it sees them as ones or zeros.
In a regular camera, a lens focuses light for a brief instant onto a piece of film or a photodiode array. In the single-pixel camera, the image from the lens is shone onto the DMD and bounced from there though a second lens that focuses the reflected light onto a single photodiode. The mirrors on the DMD are shuffled at random for each new sample. Each time the mirrors shift, a new pixel value is recorded by the photodiode. In effect, the lens and DMD do what the power-hungry microchip in the digital camera usually does: compress the data from the larger picture into a more compact form.
The prototype camera requires about five minutes to take a picture, and it fills an entire corner of one of the tables in Kelly’s laboratory. So far, only stationary objects have been photographed, but Kelly and Baraniuk say they should be able to adapt the photographic technique to produce images similar to a home snapshot. However, their initial efforts are aimed at developing the camera for scientific applications where digital photography is unavailable.
“For some wavelengths outside the visible spectrum, it’s often too expensive to produce large arrays of detectors,” Kelly says. “One of the beauties of our system is that it only requires one detector. We think this same methodology could be a real advantage in terahertz imaging and other areas.”
The research is funded by the Defense Advanced Research Projects Agency, the Office of Naval Research, the National Science Foundation, the Air Force Office of Scientific Research, and Texas Instruments’ Leadership University Program.
