NVIDIA Release Massive AI-Powered Tools and Improvements for Video, 3D and Image Creation

NVIDIA’s innovations in video editing are set to revolutionise the workflows of media creators, providing them with advanced tools and technologies to produce stunning, high-quality content. At SIGGRAPH 2024, NVIDIA introduced several enhancements to their RTX-powered video editing capabilities, focusing on delivering richer colours, greater detail, and improved visual quality.

RTX Video HDR

NVIDIA’s RTX Video HDR is a groundbreaking advancement in video editing. It allows media creators to transform their content into high-dynamic-range (HDR) video with richer colours and greater detail. This technology is now available through widespread editing software like Wondershare Filmora and DaVinci Resolve, making it accessible to a wide range of industry users. RTX Video HDR is particularly beneficial for those working on gaming videos, travel vlogs, and event filmmaking, where the visual quality of the content is paramount.

Users need an RTX GPU and an HDR10-compatible monitor or TV to utilise RTX Video HDR. This combination ensures that the enhanced video output can be fully appreciated, offering a more immersive and visually stunning viewing experience. The integration with Wondershare Filmora and DaVinci Resolve allows creators to elevate their content quality effortlessly, making HDR video production more streamlined and efficient.

In addition to improving the quality of video content, RTX Video HDR integrates seamlessly with popular media players like VLC. This integration supports RTX Video Super Resolution and RTX Video HDR, enabling AI-enhanced video playback (see below for more details). Such capabilities ensure that the final product is polished and of the highest quality.

Creators using RTX GPU-powered PCs can benefit from local RTX acceleration, significantly speeding up the export process. For instance, using dual encoders on GeForce RTX 4070 Ti or higher GPUs can double the speed of video exports. This acceleration is crucial for media professionals who need to render high-quality videos quickly and efficiently, saving valuable time and resources.

AI-Enhanced Playback

NVIDIA’s AI-enhanced playback capabilities are set to redefine the viewing experience for media creators and consumers alike. By integrating AI-driven technologies such as RTX Video Super Resolution and RTX Video HDR into popular media players like VLC, NVIDIA enables a new level of visual quality that was previously unattainable. These advancements allow for removing encoding artefacts and enhancing details, resulting in clearer, more refined video playback.

AI-enhanced playback leverages the powerful computational abilities of RTX GPUs. These GPUs use advanced AI algorithms to analyse and improve real-time video quality. For instance, RTX Video Super Resolution enhances the resolution of video content by creating new pixels and improving overall sharpness and detail without introducing unwanted artefacts. This results in a more immersive viewing experience, whether the content is consumed on a computer monitor or a large TV screen.

In addition to improving playback quality, NVIDIA’s AI enhancements offer significant practical benefits for media creators. Integrating AI technologies into the playback process can lead to substantial time savings for those using RTX GPU-powered PCs. Local RTX acceleration can double the speed of video exports when using dual encoders on GPUs like the GeForce RTX 4070 Ti or higher. This means that creators can render high-quality videos much more quickly, freeing time for additional creative work or faster project turnover.

Furthermore, the AI-enhanced playback capabilities are not limited to post-production. They also enhance the real-time viewing experience. By applying AI enhancements on the fly, media players can deliver superior video quality during playback, making it easier for editors and content creators to review their work with the highest possible fidelity. This ensures that any necessary adjustments can be identified and made promptly, improving overall workflow efficiency.

NVIDIA is pushing the boundaries of 3D artistry with innovative tools and technologies that streamline workflows and enhance creative capabilities. At SIGGRAPH 2024, several new and updated tools were showcased, offering 3D artists unprecedented control and efficiency in their creative processes.

Replikant

Replikant, an AI-assisted 3D animation platform, is revolutionising the field of 3D art by integrating advanced NVIDIA technologies. At SIGGRAPH 2024, NVIDIA highlighted how Replikant utilises NVIDIA Audio2Face to significantly enhance lip sync and facial animation, bringing characters to life with greater realism and expressiveness. By leveraging the powerful capabilities of RTX GPUs and NVIDIA DLSS technology, Replikant allows users to create real-time visuals that are not only highly detailed but also incredibly fluid.

The integration of NVIDIA Audio2Face within Replikant is a game-changer for 3D artists. Audio2Face uses AI to automatically generate facial animations based on an audio track, ensuring that the characters’ lip movements and expressions are synchronised perfectly with the spoken words. This feature drastically reduces the time and effort required to animate characters, allowing artists to focus more on the creative aspects of their projects rather than the technical details.

Replikant’s use of NVIDIA-accelerated generative models means that users can enjoy enhanced real-time visuals, vital for creating immersive and engaging content. By incorporating RTX and NVIDIA DLSS technology, Replikant ensures that animations are rendered with stunning detail and smoothness. This combination of AI and advanced graphics technology allows for a more intuitive and efficient workflow, enabling artists to produce high-quality animations with less effort.

Additionally, Replikant is accessible to a broad audience and is available on Steam. This accessibility ensures that many users, from professional animators to hobbyists, can take advantage of its powerful features. By offering a platform that combines ease of use with cutting-edge technology, Replikant sets new standards for what can be achieved in 3D animation.

Adobe Substance 3D

Adobe Substance 3D has long been a cornerstone for 3D artists, providing a robust suite of tools for texturing, material creation, and 3D modelling. At SIGGRAPH 2024, NVIDIA and Adobe showcased several exciting updates to Adobe Substance 3D, aimed at streamlining workflows and enhancing creative capabilities through advanced AI integration and RTX acceleration.

One of the standout features introduced is the Search Asset Library by Shape. This AI-powered tool simplifies replacing and enhancing complex shapes using existing 3D models. Artists can quickly search for and implement the shapes they need, significantly accelerating prototyping and design workflows. By reducing the time spent on tedious tasks, this feature allows artists to focus more on the creative aspects of their projects.

The integration of Firefly generative AI capabilities into Adobe Substance 3D Sampler and Stager represents another significant leap forward. Firefly enables advanced texturing and material creation tools, leveraging AI to produce photorealistic and stylised textures. Artists can use text-to-texture generation and prompt descriptions to generate high-quality textures that can be directly applied to 3D models. The new Generative Background feature further accelerates the staging process, making traditionally time-consuming tasks more efficient. This seamless integration of generative AI significantly enhances productivity and creativity for industrial designers, game developers, and visual effects professionals.

Another critical advancement is the utilisation of RTX Tensor Cores to accelerate computations within Substance 3D. These cores enable faster processing times, allowing artists to work more intuitively and creatively without being hindered by long rendering times. This enhancement builds on Adobe’s innovation with Firefly-powered Creative Cloud upgrades, making 3D workflows more seamless and productive.

Adobe Substance 3D also benefits from continuous updates incorporating user feedback and technological advancements. The inclusion of AI-driven features such as the Text to Texture and Generative Background significantly accelerates traditionally time-consuming and intricate tasks, enabling artists to achieve their creative vision more efficiently. These features are particularly beneficial for complex projects requiring detailed and realistic textures and materials.

Topaz AI

Topaz AI has integrated NVIDIA TensorRT acceleration into its workflows, marking a significant advancement for media creators who rely on high-performance rendering. This integration allows for the parallelisation of tasks across multiple GPUs, drastically improving rendering speeds and efficiency. Combined with NVIDIA’s cutting-edge technology, Topaz AI will enable users to handle more complex projects with greater ease and speed.

The introduction of NVIDIA TensorRT acceleration enables Topaz AI to achieve up to twice the rendering speed when utilising two GPUs compared to a single GPU system. This improvement scales even further with additional GPUs, enabling artists to work on large-scale, high-resolution projects without the usual performance bottlenecks. This capability is particularly beneficial for those working in fields that demand high computational power, such as visual effects, animation, and high-end video production.

Topaz AI’s multi-GPU acceleration is a game-changer for media creators who need to render large volumes of high-quality images and videos quickly. TensorRT allows for supercharged rendering speeds, which means artists can see the results of their work in real-time, making iterative processes more efficient. This saves time and enhances the overall workflow, enabling creators to focus more on the artistic aspects of their projects rather than being bogged down by long rendering times.

The improvements in rendering speed and efficiency do not come at the expense of quality. Topaz AI ensures that the output remains exceptionally high, with detailed, sharp images that meet the stringent demands of professional media production. The ability to handle complex rendering tasks more swiftly means that artists can push the boundaries of their creativity, exploring more intricate designs and effects that were previously too time-consuming to execute.

NVIDIA’s advancements in generative AI are transforming the landscape of image creation, offering media creators powerful tools to produce high-quality visuals with unprecedented speed and precision. Several new enhancements elevate the capabilities of generative AI for image creation, providing users with greater control and efficiency.

Getty Images Generative AI by iStock

Getty Images has significantly upgraded its Generative AI by iStock service, leveraging NVIDIA’s powerful Edify models to enhance image generation and quality. These improvements are designed to provide media creators with faster, more precise tools for producing high-quality visuals, setting new standards in the industry.

One of the most notable enhancements is the improved generation speeds. The latest updates have doubled the performance, with generation times now reaching around six seconds for four images. This rapid turnaround allows creators to produce high-quality visuals more efficiently, significantly streamlining their workflows and enabling quicker project completion.

In addition to speed, the enhanced image quality is a major advancement. The improved Text-2-Image and Image-2-Image functionalities ensure that generated images are higher quality and more accurately reflect user prompts. By utilising advanced AI models, the service provides visually stunning and precise results, meeting the specific needs of various creative projects.

Another powerful feature is the ability to customise camera settings. Users can now specify parameters such as focal length (narrow, standard, or wide) and depth of field (near or far). This level of control allows creators to tailor the generated images to their exact requirements, providing greater creative flexibility and precision in the final output.

Another key enhancement is the generative AI Super Resolution technology. This feature improves image quality by creating new pixels, significantly boosting resolution without over-sharpening. This capability ensures that the images are clear and detailed, making them suitable for high-resolution applications such as print media, marketing materials, and digital advertising.

Stable Diffusion

Stable Diffusion 3.0, the latest model from Stability AI, has been optimised with TensorRT to provide a 60% speedup. This new optimisation allows for faster and more efficient image generation, making it easier for media creators to produce high-quality visuals in less time. A NIM microservice for Stable Diffusion 3 with optimised performance is available for preview on ai.nvidia.com. This enhancement showcases NVIDIA’s commitment to pushing the boundaries of what’s possible with generative AI, offering media creators even more tools to achieve their creative visions.

The practical applications of these advancements are vast. For advertising and marketing, the ability to generate high-quality images rapidly and with precise control over visual elements allows marketers to create compelling ads that effectively capture audience attention. In social media, the speed and quality of image generation enable social media managers to produce fresh, engaging content regularly, driving higher engagement and growth. For print media, the super-resolution capabilities ensure that images are of the highest quality and suitable for editorial use in magazines, brochures, and posters.

By harnessing the power of RTX GPUs and cutting-edge AI technologies, NVIDIA sets new standards in video editing, 3D artistry, and image creation. Tools like RTX Video HDR, AI-enhanced playback, Replikant, Adobe Substance 3D, and Getty Images Generative AI by iStock provide media creators unprecedented detail, realism, and efficiency, streamlining workflows and expanding creative possibilities.

These advancements are not just incremental improvements but represent significant technological leaps. They empower artists, animators, and content creators to push the boundaries of their work. The seamless integration of AI is not just a tool but a transformative force that simplifies complex processes and enhances creative capabilities.

For businesses looking to stay ahead in the rapidly evolving digital landscape, embracing these advanced AI tools can lead to more engaging and high-quality content, improved productivity, and a competitive edge. If you want to discuss how the latest AI technologies can benefit your business, please get in touch with us at LUNIQ. We are here to help you navigate these innovations and implement solutions to drive your business forward.