Sign In

Communications of the ACM

ACM TechNews

MonoEye: A Human Motion-Capture System Using Single Wearable Camera


View as: Print Mobile App Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook
A test subject wears the system's single camera.

Researchers have developed a human motion-capture system based on an ultra-wide fisheye camera worn on the user's chest.

Credit: Tokyo Tech News

Researchers at Japan's Tokyo Institute of Technology and Carnegie Mellon University have developed a human motion-capture system comprised of an ultra-wide fisheye camera worn on the user's chest.

The MonoEye system can capture the user's body motion and their perspective, or "viewport," with a 280-degree field of view.

MonoEye incorporates three deep neural networks for real-time calculation of three-dimensional body pose, head pose, and camera pose.

The researchers trained the networks on a synthetic dataset of 680,000 renderings of people with a range of body shapes, apparel, actions, background, and lighting conditions, along with 16,000 frames of photorealistic images.

From Tokyo Institute of Technology (Japan)

 

Abstracts Copyright © 2020 SmithBucklin, Washington, DC, USA


 

No entries found