Sign In

Communications of the ACM

ACM News

Scientists Creates 'smart Cane' For Blind to 'see'


View as: Print Mobile App Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook

In 1931, the Lion's Club International began a national program promoting the use of white canes to help the blind "see." Now, scientists at the University of Arkansas at Little Rock (UALR) are turning to the organization to test a next generation "smart" cane. The device provides detail and dimension to enable the sightless to navigate in an a physical environment.

Cang Ye, associate professor of applied science in UALR's Donaghey College of Engineering and Information Technology (EIT), recently received a nationally competitive research grant of $320,389 from the U.S. National Science Foundation's Robust Intelligence Program to develop new computer vision methods and build portable blind navigational devices that may guide visually impaired people in unstructured environment.

Once the device is built, Ye will partner with rehabilitation specialists at Lion's World Services for the Blind—who's headquarters is next door to the UALR campus—and students at the Arkansas School for the Blind to help test the smart canes.

"There are no devices available that assist blind travelers in the way that Ye hopes the Smart cane will," says Larry Dickerson, chief executive officer and president of Lions World Services for the Blind. "We are eager for him to develop a working prototype. We will evaluate its effectiveness and perhaps suggest refinements with the help of our clients who come from all over the United States and our experienced staff."

Electronic white canes used by the blind have been around for several years. But Ye's research hopes to vastly improved the "vision" with smart canes can provide the sightless.

"The science of the project is to devise computer vision methods that may enable the Portable Blind Navigational Devices [PBNDs]," Ye says.

Ye and his team of researchers will use Flash LADAR (laser detection and ranging) (LADAR) 3-dimensional imaging sensor to provide the blind a more detailed "picture" of a physical environment.

"We use a Flash LADAR 3-D imaging sensor for perception," he says. "The imaging sensor produces both intensity image and range image of its environment. Each pixel in the range image contains distance information of the corresponding pixel in the intensity image."

His team has developed computer vision methods include an ego-motion estimation algorithm called VR-Odometry (VRO) and a 3-D data segmentation method. They will be refined, validated through this project and their real-time implemention in the PBNDs will be achieved at the end of the project.

"The VRO estimates the sensor's motion by simultaneously processing the intensity and range images. It will extract features in each two consecutive intensity images, match features of the two images, obtain the distance information of the matched features, and compute the change of the sensor’s position and orientation," he says. "This method can provide 'where am I?' information to the blind."

Electronic white canes used by the blind have been around for several years. But Ye's research hopes to create computer software that can detail where a staircase or a doorway is located in a room; where a drop off in the floor exists or an overhead bulkhead can be found. The core technology is 3-D data segmentation. Once the program is created, it can be installed in a portable "cane" and provide information orally to a sightless person, who then can know the lay of the land.

"This is crucial navigational information that is difficult to obtain by using a conventional white cane," Ye says. "The data segmentation method can also provide obstacle information such as an overhang obstacle or drop-off. The project's hypothesis is that a single Flash LADAR sensor can solve blind navigation problems—avoiding obstacles and way-finding. Thus it is possible to build portable navigational device."

The term "way-finding" refers to how the blind move toward a destination. Finding waypoints, such as stairways, hallways, and the awareness of his or her position contribute to the goal to move from one point to another.

The NSF grant will involve Ye, two graduate students and a number of undergraduate students at UALR's EIT college.

The initial study that led to the grant was supported in part by UALR's Office of Research and Sponsored Programs, Arkansas Space Grant Consortium, Arkansas NASA EPSCoR Program, NISH, a nonprofit agency creating ;job opportunities for people with severe disabilities; the American Society for Engineering Education; and Office of Naval Research.

"We have Lion's World Service for the Blind and Arkansas School for the Blind as our partners," Ye says. "They will help us evaluate the devices and provide opinions to refine the devices during the project period."

In 1931, the Lion's Club International began a national program promoting the use of white canes for persons who are blind. The form and the use of the white cane was further altered in 1944 when Dr. Richard Hoover developed the "long cane" or "Hoover" method of cane travel. These white canes are designed to be used as mobility devices, but maintain the symbolic role as an identifier of blind independence.


 

No entries found