Scoreboards in sports videos

Hello,

Wanted to just ask about the AI in regards to scoreboards in certain videos. The humans, ice and everything else looks great in this hockey video I am working with but Video AI seems to make a mess out of the LED scoreboard at the top of the arena. Any thoughts?

This is probably a scenario where it would be tough to preserve the detail of the scoreboard since it is visually different than the moving subjects in the clip. Would it be possible to overlay the original scoreboard on top of the upscaled video by masking it out?