Realism at Hand: A Fast and Easy Pipeline for Generating Fully Articulated Photorealistic Virtual Hands

DOI

In virtual reality (VR), using the hands instead of controllers has enormous potential for more intuitive user interactions, e.g., direct grasping, touching, or moving virtual objects. In this context, the realism of the hands plays an important role in the body ownership illusion and the user’s feeling of resence. Nevertheless, in most applications, generic 3D hand models are used that do not include individual characteristics of the user, such as  specific wrinkles, moles, or skin features. In this work, we present a pipeline to include fully articulated, photorealistic hand scans of the user in VR applications with hand tracking. This is done by capturing photos of the hand from different perspectives simultaneously using a customized hand scanner. Then, using open-source photogrammetry software, a rigged 3D model of the hand is created and integrated into a Unity application, ready to use with the OVR SDK. With our pipeline, we provide practitioners and researchers with a fast and easy way to integrate a user’s real hands into a VR application. Finally, we present guidelines on how to get from a set of 2D images to a fully articulated, personalized virtual hand model within 30 minutes.

Identifier
DOI https://doi.org/10.25592/uhhfdm.17705
Related Identifier IsPartOf https://doi.org/10.25592/uhhfdm.17704
Metadata Access https://www.fdr.uni-hamburg.de/oai2d?verb=GetRecord&metadataPrefix=oai_datacite&identifier=oai:fdr.uni-hamburg.de:17705
Provenance
Creator Hartfill, Judith ORCID logo; Rolff, Tim ORCID logo; Kruse, Lucie ORCID logo; Schmidt, Susanne ORCID logo; Steinicke, Frank ORCID logo
Publisher Universität Hamburg
Publication Year 2025
Rights Restricted Access; info:eu-repo/semantics/restrictedAccess
OpenAccess false
Representation
Resource Type Preprint; Text
Discipline Other