Data-driven Fingertip Appearance for Interactive Hand Simulation

Sheldon Andrews
McGill University
Marc Jarvis
McGill University
Paul G. Kry
McGill University

Contact on a finger pad results in deformation that redistributes blood within the fingertip tissue in a manner correlated to the pressure. We build a data-driven model that relates contact information to the visible changes of the finger nail and surrounding tissue on the back of the finger tip. Our data analysis and model construction makes use of the space of hemoglobin concentrations, as opposed to an RGB color space, which permits the model to be transferred across different fingers and different people. We use principal component analysis to build a compact model which maps well to graphics hardware with an efficient fragment program implementation. We provide a validation of our model, and a demonstration of a grasping controller running in a physically based simulation, where grip strength is visible in both hand posture and the appearance of color changes at the fingertips.

Paper [PDF, 11.4 MB]

Video [WMV, 15.1 MB]

Source code (model fitting) + Data [ZIP, 12 MB]


            title = "Data-driven Fingertip Appearance for Interactive Hand Simulation",
            journal = "ACM SIGGRAPH conference on Motion in Games (MIG)",
            year = "2013",
            author = "S. Andrews and M. Jarvis and P.G. Kry",