PAUL LACROIX 

Home Portfolio About Contact

Portfolio    My pick .  Interactive installations .  Projection Mapping .  Other .  All

October 2020: Generative art - Vector field based virtual sculpture
NGC

    At the occasion of the moving of their headquarters to Toyosu, the company NGC asked me to create a variation of one of my content so it can be placed in their lobby.

    Displayed on 4 curved screens, the content evolves and changes perpetually. Colors and shapes, as well as camera work are generated randomly in real-time.
May 2020: Parted - Body Tracking and Projection Mapping (Personal project)
Daisuke Hashimoto / Paul Lacroix / Yae Doi / Mari Katayama

    Creative Technologist

  • Technical direction
  • Creation of a system (hardware & software) able to smoothly track the performer body and accurately project video animations fitting the body shape

    • After several years experimenting on body projection mapping, this collaboration between Daisuke Hashimoto, Yae Doi and me represents a new step in the field of body projection mapping. The video is starring the Japanese artist Mari Katayama.

    Besides the cutting-edge technical aspect, we tried to create a peculiar visual, strongly inspired by the Japanese painter Ito Jakuchu. We also question the relation between identity and technology, as well as the perception of beauty and taboo within our societies.
Video
February 2020: Interactive hologram
IBM Japan / Panasonic / TypeZero

    Technical director / Software developper

  • Software development

    • Developped as a front end demo for the AI interface Watson, this hologram interacts and provides information to customers visiting the head quarters of IBM Japan.
May 2019: Markerless Face Projection Mapping on Bilal Hassani at Eurovision 2019
French Delegation for the Eurovision / Takeru Shima (CG)

    Technical Director / Technology Developper

  • Technical direction
  • Customization of the markerless face projection system for live conditions

    • Eurovision Song Contest is a huge broadcasted live event followed by 200 million viewers. Part of the French delegation, I was in charge of the Face Projection Mapping. The system had to be installed on stage in only 40 seconds, so all calibrations and tests had to be completed before. I customized and optimized the system in order to increase its robustness for such a live event. The video is a little bit dark as the lighting technician forgot to switch on the backlights during the face projection, but the face tracking and projection mapping itself went well.
Bilal Hassani / Eurovision 2019
April 2019: The Lady in the Wood (Personal project)
Paul Lacroix / Ryosuke Makita / Yae Doi

    Director / Technology developper

  • Direction, content creation
  • System development

    • Before this project, most of my facial projection mapping videos were shot in studio or at least in a location with easy access to electricity and light. The Lady in the Wood is an experiment aiming to evaluate the feasibility and robustness of using markerless face detection system in an uncontrolled environment. The video was shot in a small forest near Mont Fuji.
Video
March 2019: Experience Room (Art Installation) at Rolls Royce Motor Cars Shanghai
Paul Lacroix / Dalbin

    Technical Director

  • Design of the technical solution and installation
  • 30 screens (5x3x2) for a total resolution of 19200x3240 pixels
Video
October 2018: Interactive Bouldering Wall (Panasonic 100th anniversary)
Panasonic / P.I.C.S. - http://www.pics.tokyo

    Engineer / Consultant

  • Consultant for high-speed tracking system and its integration
  • Development of a customized library for tracking on the wall
April 2018: Interactive Content (Hiroshima The Outlets/AEON)
P.I.C.S. - http://www.pics.tokyo

    Software Engineer

  • Development of two interactive contents
  • Electronic interface for synchronizing the content with nearby elevator
Gachapon content video
March 2018: Kamiboku x Facial Mapping: Merci
P.I.C.S. - http://www.pics.tokyo / Recruit

    Technical Director / System Developper

  • Development of a Mobile Facial Projection Mapping System (hardware and software)
Merci (Official video)
Merci (Behind the scenes)
December 2017: Light Aquarium (Tokyo International Forum)
P.I.C.S. - http://www.pics.tokyo

    Software Developer / Interaction Designer

  • Home-made position sensor
  • Development of two interactive contents
Light aquarium (Official video)
October 2017: Vincent van Gogh - Face Projection Mapping (Tokyo Metropolitan Art Museum)
TECHNONET - http://www.technonet.co.jp / Van Gaban

    Director / Face Projection Mapping System Developer

  • Direction of the content creation
  • Markerless tracking customized hardware development
  • Developpement of a non-rigid markerless tracking and projection mapping software
Official video
October 2017: Interactive Content for Takashi Yanase Exhibition
TECHNONET - http://www.technonet.co.jp

    Software Developer / Interaction Designer
June 2017: EXISDANCE - Real-time tracking and projection mapping (Infocomm 2017 in Orlando)
Panasonic / P.I.C.S. - http://www.pics.tokyo

    Technical Director / 3D Tracking Engineering

  • Use of the high-speed sensor/projector of Panasonic
  • Development of a custom 3D tracking approach for the upper body in live stage conditions
  • Integration into Unity3D
  • Use of my original synchronized media player for the background projectors
EXISDANCE at Infocomm 2017 (Official video)
EXISDANCE at Infocomm 2017 (Behind the scenes)
March 2017: Facial projection mapping for the Japanese promotion of Ghost in the Shell (Facial Hacking)
P.I.C.S. - http://www.pics.tokyo

    Technical Director / Facial Projection Mapping Technology

  • Original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
    • More technical details on my blog http://paul-lacroix.tumblr.com
September 2016: Facial projection mapping for the music video The Come Down
Collaboration with Empara Mi and Hiroto Kuwahara / P.I.C.S. - http://www.pics.tokyo

    Technical Director / Facial Projection Mapping Technology

  • Design of animated texture contents
  • Development of an original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
  • Upgrade of the real-time reflective effect (mirror)
  • Creation of a new deep water effect
    • More technical details on my blog http://paul-lacroix.tumblr.com
Empara Mi - The Come Down (Official video)
Empara Mi - The Come Down (Behind the scenes)
February 2016: Development and Installation of a Real-Time Virtual Character System at SEGA Joypolis (Shanghai and Tokyo)
SEGA Live Creation - http://www.sega-live.com

  • Development and integration of an original system with a convenient workflow for content creators
  • Real-time full body motion capture and rendering, support of Lip sync
  • Support of multiple characters and props
January 2016: High-Speed Projection Mapping at CES 2016 (Las Vegas)
Panasonic / P.I.C.S. - http://www.pics.tokyo

  • Consultant for Body Projection Mapping
  • Development of interactive contents demonstrating the capabilities of the new Panasonic's High-Speed Projection Mapping system
October 2015: Upgrade of the AR Clothes Fitting system (Osaka)
Transit Digital Works - http://www.transit-dw.com

  • Customization of the system for business suits
  • System upgrade (multi-layer, auto-skinning, support of very high-resolution textures...)
  • Improvement of the calibration system
June 2015: Upgrade and Installation of the Virtual Character "Lopit" (Qingdao, China)
SEGA Live Creation - http://www.sega-live.com

  • System adjustments
April 2015: Real-time Full Body Tracking & Projection Mapping (Paris, France)
Dalbin - http://www.dalbin.com

    Technical Director

    Creation of a full body tracking and projection mapping system
  • Calibration system
  • Body tracking
  • Video texture projection
December 2014: Real-time Face Tracking & Projection Mapping for SMAPxSMAP (FUJI-TV)
Link: http://www.face-hacking.com
OMOTE members / YKBX

    Technical Director / System Architect

    New features of the Face Projection system:
  • Dual face projection mapping
  • Real-time relighting
September 2014: Installation of a 2D media server at Osaka Castle Park
Indy associates / Sharp

  • Installation of original media server synchronizating video on multiple computers
  • 27 screens (9x3) for a total resolution of 11520x2160 pixels (3x4K)
  • Adjustment of the system to handle multiple audio tracks
August 2014: OMOTE / Real-time Face Tracking & Projection Mapping
Link: http://www.project-omote.com
Collaboration with Nobumichi Asai and Hiroto Kuwahara

    Technical Director / System Creator

    Design & Development of the Real-time Face Tracking and Projection Mapping System:
  • Calibration system (projector and OptiTrack devices)
  • Original face tracking algorithm
  • Video texture projection
July 2014: Interactive Seashore Floor Projection at Enoshima Aquarium
Naked - http://www.naked-inc.com / Transit Digital Works - http://www.transit-dw.com

    Software Developper / Interaction Designer

  • Real-time water simulation
  • Interaction with infrared sensing data
  • "Night style" artistic rendering
July 2014: Simulation Program for Yokohama Dockyard Garden Projection Mapping (compatible with Oculus Rift)
P.I.C.S. - http://www.pics.tokyo

  • Simulation in first-person view of projection mapping event (used for content check or presentation)
  • Support of Oculus Rift virtual reality headset when available
March 2014: Development of a 2D media server at Haneda International Airport
Indy associates

    System Developper

  • Development of an original media server synchronizating video on multiple computers
  • Tools for data preparation and network synchronization
  • 36 screens (12x3) for a total resolution of 16392x2304
  • Technical support for interactive content on multiple screens
August 2013: Development of plugins for 3D Projection Mapping at Yokohama ORBI museum
Link: http://orbiearth.com/jp
SEGA

  • Design of the workflow for preparing contents
  • 3D Studio Max deformer plugin: alter the shape of 3D model of animals to fit a custom surface
  • After Effects plugin for easy preparation of the mapping contents
  • 3D Simulation software for preview
July 2013: Color correction system at Yokohama Dockyard Garden 3D Projection Mapping
Link: http://www.youtube.com/watch?v=jyst4YhSEgg
P.I.C.S. - http://www.pics.tokyo

  • Automatic color calibration of the wall for 8 projectors
  • Real-time color correction
2013: Nuke plugin for realistic brush contours from 3D animation videos
Polygon Pictures Inc. - http://www.ppi.co.jp
November 2012: Consultant at Caretta Shiodome projection mapping
Link: http://www.youtube.com/watch?v=fP9JlLS0tQo
Polygon Pictures Inc. - http://www.ppi.co.jp

  • Design of the content workflow
  • Projection simulation
July 2012: Image Technical Director for the renewing of SEGA Tokyo Joypolis
Link: http://tokyo-joypolis.com/stageshow
Polygon Pictures Inc. - http://www.ppi.co.jp

  • Design and development of the system of real-time 3D virtual character
  • Evaluation of several 3D Projection Mapping systems
  • Design of the reference content templates and development of an After Effects plugin for template transformation
  • 3D Simulation software for preview
April 2012: Project Leading Engineer on AR Garment Fitting Project
Link: http://www.youtube.com/watch?v=gguTQHfoD_8
Transit Digital Works - http://www.transit-dw.com

  • Research and Development, system design
  • Real-time cloth physics simulation
  • Kinect skeleton data filtering/retargeting, improvement of the body detection quality
  • Cloth database management system
January 2012: Interactive content for the 100 Years anniversary of Sharp
Ittocan - http://www.ittocan.co.jp

    Design Concept Graphic User Interface using both touch screen and Kinect motion sensing
November 2011: Consultant at Seikei University 3D Projection Mapping
Link: http://vimeo.com/33150921
P.I.C.S. - http://www.pics.tokyo / Polygon Pictures Inc. - http://www.ppi.co.jp

    Technical supervisor / Software Developper

  • Technical Supervision
  • Creation of a After Effects plugin for wall color correction
October 2011: Interactive content at Ecobuild event (Tokyo International Forum)
Ittocan - http://www.ittocan.co.jp

    Technical Director / Interaction Designer

    Multiple screens (8K pixels wide), double camera sensing
August 2011: Consultant for optimizing the project management workflow on the TV series Transformers
Polygon Pictures Inc. - http://www.ppi.co.jp
June 2011: Nuke cutout filter with temporal stability used in the TV serie Tron Uprising
Polygon Pictures Inc. - http://www.ppi.co.jp
March 2011: Nuke plugin for automatic normal map generation from handmade celluloid used in the TV serie Tron Uprising
Polygon Pictures Inc. - http://www.ppi.co.jp
2010: Realistic brush animation software
Polygon Pictures Inc. - http://www.ppi.co.jp

  • Real time drawing capture
  • Stroke path edition
  • Progressive stroke drawing
  • Object animation with spline interpolation
  • Real-time preview and high quality rendering
  • User interface developed using Qt
September 2010: Interactive content at Sky Hall Penthouse Wedding
Widget Inc.
October 2010: Interactive content at Sign Kasumigaseki
Widget Inc. / JET Agency
February 2010: Interactive contents at Aquamarine Fukushima
Widget Inc.

    Technical Direction / Interaction Designer
November 2009: Interactive content for the live show Keio NetBand Wa-i
Link: http://www.youtube.com/watch?v=x8wrUYP4uRE
Widget Inc.
2009: Real time fluid manipulation software used within introduction videos of a video game
Polygon Pictures Inc. - http://www.ppi.co.jp

  • Fluid and particle simulation
  • Real time drawing, edition and visualization
  • Importation of camera data from MAYA
  • User interface developed using MFC
2009: Conception and management of an interactive digital signage project
Widget Inc.

  • Research and development about visual sensing algorithms used with standard camera (motion and position estimation, face detection and tracking)
  • Promotion (website, documents, presentation video editing)
  • Customer relations, project budget estimation
  • Design of interactive content by using Flash or C++/OpenGL
  • Development of customizable content templates and their IDE
  • System installation, calibration and maintenance
2008: Work on a real-time video compositing embedded system for karaoke
Widget Inc.

  • Development of an ActiveX Control performing camera capture, compositing and recording to MPEG-2 file
  • Creation of customized DirectShow filters
  • Programming of software adjusting automatically the volume amplitude of audio data (robust approach)
  • Evaluation of several video compression formats for optimal display on mobile phone
  • Programming of software/hardware/network diagnostic software
  • Prototyping of a new interface connecting two devices in order to decrease the system cost
2008: Volume rendering of brain sequences for the new version of the animation movie Ghost In The Shell 2.0
Polygon Pictures Inc. - http://www.ppi.co.jp
2007: Development of a real-time task management Web application used for organizing the tasks of more than one hundred employees
Polygon Pictures Inc. - http://www.ppi.co.jp

    This application was used in the context of the American TV series My Friends Tigger and Pooh
2006: Software research and development
Voxelan

  • Digital measurements on 3D models
  • Scan anonymization
  • Scan stitching
  • Documentation, demonstration and training related with the software
  • Upgrade of the company 's website
  • Research and evaluation of methods especially in the following fields:
  • Processing of images and depth maps (Digital Elevation Model)
  • Scanner calibration, correction of the lens distortion
  • Mesh operations (polygonization, merging, simplification, comparison, positioning...)
  • Use of various data structures for optimization (octree, kd-tree...)
2004: Development of visualization and processing software for volume images
Pierre Fabre - http://www.pierre-fabre.com

  • Reading volume data from DICOM files
  • Volume data processing
  • Programming of a volume rendering engine (real-time mode with texture stack approach, high quality mode with ray casting algorithm)
  • Polygonization of vascular network
  • Participation in the authoring of a software development normalization document
  • Software training
2003: Development of control software for a 3D scanner used in dermatology
Pierre Fabre - http://www.pierre-fabre.com

  • Calibration of a vision system
  • Construction of 3D mesh from profilometer data
  • Color correction
  • Projection/merging of 2D textures on the 3D mesh
  • Research about mesh construction algorithms, publication of an article
Copyright (c) 2009-2020 Paul Lacroix