Portfolio    My pickInteractive installationsProjection MappingOtherAll

Mai 2019: Markerless Face Projection Mapping on Bilal Hassani at Eurovision 2019
French Delegation for the Eurovision/Takeru Shima (CG)

    Technical Director/Technology Developper

  • Technical direction
  • Customization of the markerless face projection system for live conditions

  • Eurovision Song Contest is a huge broadcasted live event followed by 200 million viewers. Part of the French delegation, I was in charge of the Face Projection Mapping. The system had to be installed on stage in only 40 seconds, so all calibrations and tests had to be completed before. I customized and optimized the system in order to increase its robustness for such a live event. The video is a little bit dark as the lighting technician forgot to switch on the backlights during the face projection, but the face tracking and projection mapping itself went well.
Bilal Hassani / Eurovision 2019
April 2019: The Lady in the Wood (Personal project)

    Director/Technology developper
  • Direction, content creation
  • System development
October 2018: Interactive Bouldering Wall (Panasonic 100th)
Panasonic / P.I.C.S. -

  • Consultant for high-speed tracking system and its integration
  • Development of a customized library for tracking on the wall
April 2018: Interactive Content (Hiroshima The Outlets/AEON)
P.I.C.S. -

    Software Engineer
  • Development of two interactive contents
  • Electronic interface for synchronizing the content with nearby elevator
Gachapon content video
March 2018: Kamiboku x Facial Mapping: Merci
P.I.C.S. - / Recruit

    Technical Director / System Developper
  • Development of a Mobile Facial Projection Mapping System (hardware and software)
Merci (Official video)
Merci (Behind the scenes)
December 2017: Light Aquarium (Tokyo International Forum)
P.I.C.S. -

    Software Developer/Interaction Designer
  • Home-made position sensor
  • Development of two interactive contents
Light aquarium (Official video)
October 2017: Vincent van Gogh - Face Projection Mapping (Tokyo Metropolitan Art Museum)
TECHNONET - / Van Gaban

    Director / Face Projection Mapping System Developer
  • Direction of the content creation
  • Markerless tracking customized hardware development
  • Developpement of a non-rigid markerless tracking and projection mapping software
Official video
October 2017: Interactive Content for Takashi Yanase Exhibition

June 2017: EXISDANCE - Real-time tracking and projection mapping (Infocomm 2017 in Orlando)
Panasonic / P.I.C.S. -

    Technical Director / 3D Tracking Engineering
  • Use of the high-speed sensor/projector of Panasonic
  • Development of a custom 3D tracking approach for the upper body in live stage conditions
  • Integration into Unity3D
  • Use of my original synchronized media player for the background projectors
EXISDANCE at Infocomm 2017 (Official video)
EXISDANCE at Infocomm 2017 (Behind the scenes)
March 2017: Facial projection mapping for the Japanese promotion of Ghost in the Shell (Facial Hacking)
P.I.C.S. -

    Technical Director / Facial Projection Mapping Technology
  • Original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
  • More technical details on my blog
September 2016: Facial projection mapping for the music video The Come Down
Collaboration with Empara Mi and Hiroto Kuwahara / P.I.C.S. -

  • Design of animated texture contents
  • Development of an original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
  • Upgrade of the real-time reflective effect (mirror)
  • Creation of a new deep water effect
  • More technical details on my blog
Empara Mi - The Come Down (Official video)
Empara Mi - The Come Down (Behind the scenes)
February 2016: Development and Installation of a Real-Time Virtual Character System at SEGA Joypolis (Shanghai and Tokyo)
SEGA Live Creation -

  • Development and integration of an original system with a convenient workflow for content creators
  • Real-time full body motion capture and rendering, support of Lip sync
  • Support of multiple characters and props
January 2016: High-Speed Projection Mapping at CES 2016 (Las Vegas)
Panasonic / P.I.C.S. -

  • Consultant for Body Projection Mapping
  • Development of interactive contents demonstrating the capabilities of the new Panasonic's High-Speed Projection Mapping system
October 2015: Upgrade of the AR Clothes Fitting system (Osaka)
Transit Digital Works -

  • Customization of the system for business suits
  • System upgrade (multi-layer, auto-skinning, support of very high-resolution textures...)
  • Improvement of the calibration system
June 2015: Upgrade and Installation of the Virtual Character "Lopit" (Qingdao, China)
SEGA Live Creation -

  • System adjustments
April 2015: Real-time Full Body Tracking & Projection Mapping (Paris, France)
Label Dalbin -

    Creation of a full body tracking and projection mapping system
  • Calibration system
  • Body tracking
  • Video texture projection
December 2014: Real-time Face Tracking & Projection Mapping for SMAPxSMAP (FUJI-TV) -
OMOTE members / YKBX

    Technical Director / System Architect
    New features of the Face Projection system:
  • Dual face projection mapping
  • Real-time relighting
September 2014: Installation of a 2D media server at Osaka Castle Park
Indy associates / Sharp

  • Installation of original media server synchronizating video on multiple computers
  • 27 screens (9x3) for a total resolution of 11520x2160 pixels (3x4K)
  • Adjustment of the system to handle multiple audio tracks
August 2014: OMOTE / Real-time Face Tracking & Projection Mapping -
Collaboration with Nobumichi Asai and Hiroto Kuwahara

    Technical Director / Design & Development of the Real-time Face Tracking and Projection Mapping System:
  • Calibration system (projector and OptiTrack devices)
  • Original face tracking algorithm
  • Video texture projection
July 2014: Interactive Seashore Floor Projection at Enoshima Aquarium
Naked - / Transit Digital Works -

  • Real-time water simulation
  • Interaction with infrared sensing data
  • "Night style" artistic rendering
July 2014: Simulation Program for Yokohama Dockyard Garden Projection Mapping (compatible with Oculus Rift)
P.I.C.S. -

  • Simulation in first-person view of projection mapping event (used for content check or presentation)
  • Support of Oculus Rift virtual reality headset when available
March 2014: Development of a 2D media server at Haneda International Airport
Indy associates

  • Development of an original media server synchronizating video on multiple computers
  • Tools for data preparation and network synchronization
  • 36 screens (12x3) for a total resolution of 16392x2304
  • Technical support for interactive content on multiple screens
August 2013: Development of plugins for 3D Projection Mapping at Yokohama ORBI museum -

  • Design of the workflow for preparing contents
  • 3D Studio Max deformer plugin: alter the shape of 3D model of animals to fit a custom surface
  • After Effects plugin for easy preparation of the mapping contents
  • 3D Simulation software for preview
July 2013: Color correction system at Yokohama Dockyard Garden 3D Projection Mapping -
P.I.C.S. -

  • Automatic color calibration of the wall for 8 projectors
  • Real-time color correction
2013: Nuke plugin for realistic brush contours from 3D animation videos
Polygon Pictures Inc. -

November 2012: Consultant at Caretta Shiodome projection mapping -
Polygon Pictures Inc. -

  • Design of the content workflow
  • Projection simulation
July 2012: Image Technical Director for the renewing of SEGA Tokyo Joypolis -
Polygon Pictures Inc. -

  • Design and development of the system of interactive 3D character
  • Evaluation of several 3D Projection Mapping systems
  • Design of the reference content templates and development of an After Effects plugin for template transformation
  • 3D Simulation software for preview
April 2012: Project Leading Engineer on AR Garment Fitting Project -
Transit Digital Works -

  • Research and Development, system design
  • Real-time cloth physics simulation
  • Kinect skeleton data filtering/retargeting, improvement of the body detection quality
  • Cloth database management system
January 2012: Interactive content for the 100 Years anniversary of Sharp
Ittocan -

    Design Concept Graphic User Interface using both touch screen and Kinect motion sensing
November 2011: Consultant at Seikei University 3D Projection Mapping -
P.I.C.S. - / Polygon Pictures Inc. -

  • Technical supervisor
  • Creation of a After Effects plugin for wall color correction
October 2011: Interactive content at Ecobuild event (Tokyo International Forum)
Ittocan -

    Multiple screens (8K pixels wide), double camera sensing
August 2011: Consultant for optimizing the project management workflow on the TV series Transformers
Polygon Pictures Inc. -

June 2011: Nuke cutout filter with temporal stability used in the TV serie Tron Uprising
Polygon Pictures Inc. -

March 2011: Nuke plugin for automatic normal map generation from handmade celluloid used in the TV serie Tron Uprising
Polygon Pictures Inc. -

2010: Realistic brush animation software
Polygon Pictures Inc. -

  • Real time drawing capture
  • Stroke path edition
  • Progressive stroke drawing
  • Object animation with spline interpolation
  • Real-time preview and high quality rendering
  • User interface developed using Qt
September 2010: Interactive content at Sky Hall Penthouse Wedding
Widget Inc.

October 2010: Interactive content at Sign Kasumigaseki
Widget Inc. / JET Agency

February 2010: Interactive contents at Aquamarine Fukushima
Widget Inc.

November 2009: Interactive content for the live show Keio NetBand Wa-i -
Widget Inc.

2009: Real time fluid manipulation software used within introduction videos of a video game
Polygon Pictures Inc. -

  • Fluid and particle simulation
  • Real time drawing, edition and visualization
  • Importation of camera data from MAYA
  • User interface developed using MFC
2009: Conception and management of an interactive digital signage project
Widget Inc.

  • Research and development about visual sensing algorithms used with standard camera (motion and position estimation, face detection and tracking)
  • Promotion (website, documents, presentation video editing)
  • Customer relations, project budget estimation
  • Design of interactive content by using Flash or C++/OpenGL
  • Development of customizable content templates and their IDE
  • System installation, calibration and maintenance
2008: Work on a real-time video compositing embedded system for karaoke
Widget Inc.

  • Development of an ActiveX Control performing camera capture, compositing and recording to MPEG-2 file
  • Creation of customized DirectShow filters
  • Programming of software adjusting automatically the volume amplitude of audio data (robust approach)
  • Evaluation of several video compression formats for optimal display on mobile phone
  • Programming of software/hardware/network diagnostic software
  • Prototyping of a new interface connecting two devices in order to decrease the system cost
2008: Volume rendering of brain sequences for the new version of the animation movie Ghost In The Shell 2.0
Polygon Pictures Inc. -

2007: Development of a real-time task management Web application used for organizing the tasks of more than one hundred employees
Polygon Pictures Inc. -

    This application was used in the context of the American TV series My Friends Tigger and Pooh
2006: Software research and development

  • Digital measurements on 3D models
  • Scan anonymization
  • Scan stitching
  • Documentation, demonstration and training related with the software
  • Upgrade of the company 's website
  • Research and evaluation of methods especially in the following fields:
  • Processing of images and depth maps (Digital Elevation Model)
  • Scanner calibration, correction of the lens distortion
  • Mesh operations (polygonization, merging, simplification, comparison, positioning...)
  • Use of various data structures for optimization (octree, kd-tree...)
2004: Development of visualization and processing software for volume images
Pierre Fabre -

  • Reading volume data from DICOM files
  • Volume data processing
  • Programming of a volume rendering engine (real-time mode with texture stack approach, high quality mode with ray casting algorithm)
  • Polygonization of vascular network
  • Participation in the authoring of a software development normalization document
  • Software training
2003: Development of control software for a 3D scanner used in dermatology
Pierre Fabre -

  • Calibration of a vision system
  • Construction of 3D mesh from profilometer data
  • Color correction
  • Projection/merging of 2D textures on the 3D mesh
  • Research about mesh construction algorithms, publication of an article