Face Embedding Conditioned Transformer For 3D Face Reconstruction
Here I will describe one of my recent experiments with 3D face reconstruction, based on this awesome Disney paper. Using paper’s transformer decoder architecture, with cross-covariance attention (XCiT) conditioned and modulated with face embeddings, I was able to improve the quality of reconstructed faces. Since I was lacking a sufficiently large 3D head shape dataset, I decided to generate my own dataset using HRN which scores among the highest on 3D Face Reconstruction benchmark....