After Removing the Background, the Characters Became Semi-Transparent Too
๐ Originally published (in Japanese) at forge.workstyle.tech . I was investigating a bug where the face and jaw were misaligned. While zooming in on the areas before and after the boundary and lining them up, I noticed something else. Eve's head was slightly transparent. You could see the background bleeding through just a bit. The same was true for the grey shirt. Even Dario's stubble hadโฆ
In the course of debugging a character misalignment issue, the researcher observed that characters in the lip-sync videos became semi-transparent when the background was removed. This was noticeable in areas with skin tones and subtle gray elements, such as Aibu's head, Dario's stubble, and the character's shirt fabric. The transparency occurred because certain colors within the character were close to the background color.
The colorkey threshold value was set at 0.17 for determining background similarity, and 0.08 for smoothing the boundary. Characters with lighter colorations were more affected by this threshold. The researcher found that a narrower threshold could result in too much character extraction, while a wider threshold led to background residue.
They conducted tests with different threshold values and concluded that 0.17 provided the best balance between removing the background and retaining the characters. To ensure transparency was visible, they recommended overlaying semi-transparent areas against a background of a different color.
Written by urgent.news from Dev.to's reporting โ not their text. Machine-written โ may contain errors; check the original before relying on it.