"FACE HACKING" was a real-time facial projection mapping performance that aired on the Japanese variety show SMAP×SMAP (Fuji TV) on December 22, 2014. A variety of carefully crafted animated content was projected onto the performers' faces.

The face tracking technology was an upgraded version of the original tech that I developed during the Omote project, now able to track two faces simultaneously. Another enhancement was real-time relighting: shadows on the face were computed on-the-fly based on the position and orientation of the face. Though subtle in the video, it contributed significantly to the realism of the effect.