Researchers at Japan's Tokyo Institute of Technology and Carnegie Mellon University have developed a human motion-capture system comprised of an ultra-wide fisheye camera worn on the user's chest.
The MonoEye system can capture the user's body motion and their perspective, or "viewport," with a 280-degree field of view.
MonoEye incorporates three deep neural networks for real-time calculation of three-dimensional body pose, head pose, and camera pose.
The researchers trained the networks on a synthetic dataset of 680,000 renderings of people with a range of body shapes, apparel, actions, background, and lighting conditions, along with 16,000 frames of photorealistic images.
From Tokyo Institute of Technology (Japan)
Abstracts Copyright © 2020 SmithBucklin, Washington, DC, USA
No entries found