4x3 to 16x9 frame fill

I’m upscaling a bunch of 640x480 SD interviews and a few times the camera gets into a tight close up that will be too tight once cropped for the final 16x9 aspect ratio, I’m realizing how great it would be to use the wide shots to fill in the rest of the 16x9 image behind the person talking on the outside pillars of the frame.