PAUL LACROIX 
Panasonic / P.I.C.S. - http://www.pics.tokyo
Technical Director / 3D Tracking Engineering
  • Use of the high-speed sensor/projector of Panasonic
  • Development of a custom 3D tracking approach for the upper body in live stage conditions
  • Integration into Unity3D
  • Use of my original synchronized media player for the background projectors

Following the CES 2016 project with Panasonic, and building on continuous research into face projection mapping, EXISDANCE marked a new milestone in body projection mapping. Presented at InfoComm 2017 in Orlando, and performed a year later on America's Got Talent, the project featured real-time tracking and projection mapping on the torso, using Panasonic's high-speed sensor/projector system.


Unlike a rigid tracking approach, the system could follow deformation in real time, using a skeleton-based deformer that animated the projected mesh along with the dancer's movement, greatly improving realism even during complex choreography.


Rendering was done in Unity, which simplified integration and allowed for richer 3D content. Background visuals were handled by my original media server, synchronized with the Unity content.