I am currently using a 2019 Mac Pro with Radeon Pro 580X. The performance is at best acceptable, not much faster than the Intel Xeon, if at all. I am looking for some GPU upgrade options so I can preview my edit easier. However I have hard time to find detailed information about a right one to fit my requirement.
First as a start, I did my due diligence to find suggestions for each apps. They are a little bit too high level. From user support PoV I would hope the team to share the inference time for realistic test cases on at least several tier hardware ranging from professional grade NVidia/AMD GPU to gaming level GPU and laptop GPU then CPU-only. For example for Nvidia/AMD I would be interested to see the following:
- Quadro Series
- GeForce GTX 2-Series
- GeForce GTX 1-Series
- Radeon Pro Vega II
- Radeon Pro W5xxx series
- Radeon Pro 5xxxM series
Second, to be a bit more technical, usually each of these cards has different computing capability ranging from INT8/FP16/FP32/FP64 as well as its memory bandwidth. Right now I am completely blindsighted what is the required computing resource I should be buying for. I can only guess most of the machine learning inference is performed somewhere at FP16 and FP32, and there will be a performance degradation while I run metal on macOS comparing to CUDA on Windows. The GPU I am looking to buy is ranging from one thousand to three thousand dollars, it could easily top a high end MacBook Pro so I don’t want to bet a sizable investment based on pure speculation.
It would be nice if the team can provide some technical publication or test report on various hardware, or maybe create a tool for the community to benchmark and report the performance running these applications on their platform. The customer experience will be greatly improved.