Today we’re thrilled to release Iris v1, the first face enhancement AI model designed specifically for video. Iris works best on interlaced, noisy, or compressed footage with degraded faces. After updating to Topaz Video AI v3.3, you can find Iris in the Enhancement filter under any Video Type:
As humans, we’re uniquely sensitive to seeing faces that look slightly off. The same methods that create believable texture on foliage, buildings, wildlife, and other subjects can often fail completely on human faces.
Face Recovery from Topaz Photo AI works well on still images but often appears unnatural when applied to video. The slight differences in orientation between each frame create compounding artifacts when stitched together. In order to solve this, Iris uses information from the same face across multiple video frames to achieve significantly better quality than was previously possible:
Iris minimizes flickering, artifacts, and motion inconsistency, and as a result offers more natural and detailed face enhancement than any other video tool currently available.
When upscaling low-quality videos with degraded faces, Iris offers significantly clearer, more detailed, and more natural results than Proteus or Artemis.
Iris was trained to aggressively remove extreme levels of noise and degradation from low-quality videos, so it has a tendency to remove detail from higher-quality footage. We still recommend Proteus or Artemis to enhance texture and detail in higher-quality videos with larger faces.
Iris is designed as a flexible model for all input videos, so it works well on both interlaced and progressive footage. In fact, we’ve found that it will often produce better results than the specialized Dione deinterlacing model, even for interlaced videos without faces.
Use the new “Recover Original Detail” function to intelligently blend fine texture from the source footage into the output. Find the new slider in the Enhancement filter with Iris, Proteus, or Artemis selected:
This pairs well with Iris in cases where it creates unnatural detail or overly smoothes the footage. Increasing this slider can reduce unnatural smoothness from AI enhancement, but can also bring back noise and compression artifacts. We also recommend caution when combining this with the Add Noise slider, as the noise might also show up in the output.
We hope you enjoy using Iris. Please let us know what you think and what you want to see next!
Since May’s update post we’ve improved on app input/output and stability:
- Audio streams with metadata are now preserved in output
- Default encoder for new installs set to H264 High
- Added DPX support
- Corrupted model files are now automatically re-downloaded
- Fixed Estimate for some image sequences
- Fixed copy ffmpeg command button
- Fixed output video preset issue
- Fixed occasional permissions issues when updating or uninstalling
- Fixed occasional importing issues and processing failures on Mac
- Max Processes now defaults to 1
- Preview frame limit increased to 900
- Failed processing now shows more specific errors
- Various UI improvements for dialog boxes, buttons, and tooltips
We’re working on a few concrete features that should wrap up within the next few months:
- Detect scene changes internally to improve Stabilization and Frame Interpolation quality for videos with multiple scenes.
- Allow pausing and resuming exports.
- Faster playback and seeking in the in-app preview.
- Allow applying a second Enhancement pass without exporting and re-importing.
- Improve Output Settings interface and add audio transcoding options.
We’re also exploring a few directions that we could use your feedback on:
- Explore NLE integration with popular editors. What are some other plugins that you use that you think we should look at?
- Explore the next generation of video enhancement models for medium-quality and high-quality footage that will eventually replace Artemis/Gaia/Proteus. What kinds of use cases would you be most interested in, and could you provide sample videos?
- Explore a specific noise reduction model for 1x enhancement for noisy or low-light videos. Do you have noisy or degraded footage that Proteus/Iris currently fails with at 1x?
Please comment and upload videos to Dropbox, and apply for the video beta program if you’d like pre-release access to new features. We’re excited to make some major improvements to Topaz Video AI in the next year, so we look forward to hearing your feedback.