Research and scientific works as a part of the “Mnemosis - mobile technology for motion and texture acquisition in 4K” project

The Faculty of Mechatronics has been developing 3D scanning methods for many years. In the last decade we have also started research work in the field of 3D measurements performed many times per second, from many directions simultaneously. The main measurement objects are people in motion.

The Mnemosis project is a joint initiative of Stars Impresariat Filmowy S.A. and the team from the Department of Virtual Reality Technology (ZTRW), which consists in developing a system for the acquisition of character movement in complex 3D scenes with photorealistic accuracy.

The team from ZTRW is responsible for the development of a multimodal method for geometry (XYZ) and texture (RGB) measurement integrating techniques with structured lighting, "Structure from Motion" in passive and active versions and geometry from the surroundings. Currently, there is no single measurement method to accurately reconstruct the geometry and surface texture of time-varying objects. The aim of the work carried out by the ZTRW team is to develop four measurement methods and data fusion allowing for the generation of a photorealistic model in the form of a 4D point cloud.

Collaboration with male and female students of the Faculty is welcomed in the implementation of the project work. The subject matter of the project is very broad and makes it possible to carry out work in very many directions. It is also possible to realise tutoring programmes and to conduct diploma theses in this subject area.

The expected outcome of the project is the development of a new product allowing for the generation of visually and qualitatively better character animations and acceleration and automation of the character animation process.

Photo: Clouds of points from dynamic measurements