Researchers from Codec Avatars Lab, Meta, and Nanyang Technological University have developed URHand, a Universal Relightable Hand model. It achieves photorealistic representation and generalization across viewpoints, poses, illuminations, and identities by combining physically based rendering and neural relighting. The model outperforms baseline methods and showcases adaptability beyond studio data, offering quick personalization. Read about the project and follow the researchers on social media for updates.
“`html
Introducing URHand: A Universal Relightable Hand AI Model
The constant visibility of hands in our daily activities makes them crucial for a sense of self-embodiment. The problem is the need for a digital hand model that is photorealistic, personalized, and relightable. Photorealism ensures a realistic visual representation, personalization caters to individual differences, and reliability allows for a coherent appearance in diverse virtual environments, contributing to a more immersive and natural user experience.
Practical Solutions and Value
URHand is the first Universal Relightable Hand model, designed to generalize across viewpoints, motions, illuminations, and identities. It combines physically based rendering and data-driven appearance modeling using neural relighting, achieving high-fidelity relightable hands. The model enables quick personalization from a phone scan, showcasing its adaptability beyond studio data.
Comparative Performance
Comparing URHand with state-of-the-art 3D hand relighting and reconstruction methods, including RelightableHands and Handy, URHand significantly outperforms baseline methods in per-identity training, reproducing detailed geometry, specularities, and shadows, surpassing the quality of other methods.
AI Solutions for Middle Managers
If you want to evolve your company with AI, stay competitive, and use URHand for your advantage. Discover how AI can redefine your way of work by identifying automation opportunities, defining KPIs, selecting an AI solution, and implementing gradually. Connect with us for AI KPI management advice and explore the AI Sales Bot designed to automate customer engagement 24/7 and manage interactions across all customer journey stages.
For more information, check out the Paper and Project.
All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. Join our 36k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.
If you like our work, you will love our newsletter. Subscribe for continuous insights into leveraging AI.
“`
List of Useful Links:
- AI Lab in Telegram @aiscrumbot – free consultation
- NTU and Meta Researchers Introduce URHand: A Universal Relightable Hand AI Model that Generalizes Across Viewpoints, Poses, Illuminations, and Identities
- MarkTechPost
- Twitter – @itinaicom
