I tried NVIDIA's DLSS 5.0 for Facial Emotion Recognition with Synthetic Data

Seeing NVIDIA' s DLSS 5.0 showcased everywhere in various video games, I tested the extent to which this tech can reduce the sim2real appearance gap for computer vision. Considering that the model mostly apply strong changes to the faces of the characters, I employed a synthetic dataset for facial emotion recognition with UE5 MetaHumans. A ResNet-50 model was trained to classify three classes, namely, Neutral, Sad, and Surprise, first using the original images and then the identical images enhanced by DLSS 5.0. Subsequently, these were cross-evaluated on real-world facial recognition datasets.