# Official test video and benchmark distribution and analysis

**URL:** <https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376>\
**Category:** Ideas\
**Tags:** reviewed\
**Created:** [March 10, 2023, 4:35am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376 "2023-03-10T04:35:13Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![TicoRodriguez](https://community.topazlabs.com/user_avatar/community.topazlabs.com/ticorodriguez/32/97346_2.png) [@TicoRodriguez](https://community.topazlabs.com/u/TicoRodriguez)\
**Post date:** [March 10, 2023, 4:35am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/1 "2023-03-10T04:35:13Z")

</div>

Can Topaz distribute test videos and benchmarks to beta testers to investigate what the bottlenecks are by conducting a common test?

Currently, each tester is using different videos and different methods to investigate, so the test results are inconsistent.

For example, if we prepare 480i, 480p, 1080i, and 1080p test videos, perform common tests such as 2x scale and 4x scale, and have them compare the specs of each PC (CPU, GPU, MEM, SSD, HDD…) If we let them compare the results, it would be easier to grasp the cause of the problem.  
Also, if the models and versions tested are collected, comparisons can be made easily.

The benchmark results obtained would also be useful for users to consider what they can do to improve the speed of their PCs.

- Video for testing
- Benchmarking tools
- Dedicated site for submitting benchmarks(It is preferable that users can view and compare the collection results. Examples are 3D Mark.)

I strongly request that the above.

---

<div class="post-metadata">

**Author:** ![ForSerious](https://community.topazlabs.com/user_avatar/community.topazlabs.com/forserious/32/170142_2.png) [@ForSerious](https://community.topazlabs.com/u/ForSerious)\
**Post date:** [March 10, 2023, 5:59am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/2 "2023-03-10T05:59:40Z")

</div>

This would be awesome. The site with uploaded results would be great for people to determine what kind of hardware they might need to upgrade or not.

---

<div class="post-metadata">

**Author:** ![lhkjacky](https://community.topazlabs.com/user_avatar/community.topazlabs.com/lhkjacky/32/256798_2.png) [@lhkjacky](https://community.topazlabs.com/u/lhkjacky)\
**Post date:** [March 10, 2023, 10:00am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/4 "2023-03-10T10:00:35Z")

</div>

> [@TicoRodriguez](#):
>
> Can Topaz distribute test videos and benchmarks to beta testers to investigate what the bottlenecks are by conducting a common test?

Quote from Developer,

> [@On another topic](https://community.topazlabs.com/t/39217/14):
>
> Will just add a benchmark menu item that will just run a few models and report numbers, along with system info so they are easy to post.  
> Will do this once all the performance improvements are finished.

---

<div class="post-metadata">

**Author:** ![TicoRodriguez](https://community.topazlabs.com/user_avatar/community.topazlabs.com/ticorodriguez/32/97346_2.png) [@TicoRodriguez](https://community.topazlabs.com/u/TicoRodriguez)\
**Post date:** [March 10, 2023, 10:48am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/5 "2023-03-10T10:48:44Z")

</div>

What I want, as I wrote in another thread, is the ability to do the same test and compare between users.

If only a benchmarking function is included, it is not possible to compare users because each user can only test with whatever videos they want.

By comparing the results of common test videos processed with the same settings, we can measure the difference in processing speed due to differences between CPUs, GPUs, and VEAI ver, which can be information for Topaz to investigate software bottlenecks and for users to enhance their hardware.

---

<div class="post-metadata">

**Author:** ![malta.tx](https://community.topazlabs.com/letter_avatar_proxy/v4/letter/m/ecae2f/32.png) [@malta.tx](https://community.topazlabs.com/u/malta.tx)\
**Post date:** [March 10, 2023, 8:42pm UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/6 "2023-03-10T20:42:28Z")

</div>

A positive and necessary associative proposal. Compare real results starting from the same source.  
Words should be superfluous in an image… this practical comparison creates bridges and facilitates the necessary understanding between computer scientists and Topaz users.  
どうもありがとう

---

<div class="post-metadata">

**Author:** ![lhkjacky](https://community.topazlabs.com/user_avatar/community.topazlabs.com/lhkjacky/32/256798_2.png) [@lhkjacky](https://community.topazlabs.com/u/lhkjacky)\
**Post date:** [March 11, 2023, 2:28am UTC](https://community.topazlabs.com/t/official-test-video-and-benchmark-distribution-and-analysis/41376/7 "2023-03-11T02:28:58Z")

</div>

> [@On another topic](https://community.topazlabs.com/t/41416/1):
>
> Starting with Topaz Video AI v3.1.9 you will be able to run the models against standard inputs to able to compare results across different machines. This option doesn’t transmit any data and is completely up to the user to share. Once benchmarking is finished you can copy and paste results here.
> 
> ![Screenshot 2023-03-10 at 3.57.50 PM](https://community-cdn.topazlabs.com/original/3X/6/a/6abfa8603c6f777eeb1a94c96df9a3219f4b3331.png)

[https://community.topazlabs.com/t/performance-benchmarking/41416?u=lhkjacky](https://community.topazlabs.com/t/performance-benchmarking/41416)
