I think I found what might cause the crashes with the Remove tool! If I turn on upscaling and then turn it off before I use the Remove tool, the latter no longer crashes until the next launch of the program! I think there is some dependency that makes the Remove tool crash if something from the upscaling models is not loaded first.
I hope this helps with fixing this bug. Let me know if you need any more info.