Is it possible to create a model that runs on yuv420 instead of rgb

Would process the video in its original pixel format give better result?