Decart's Lucy 2.5 introduces new live video effects, but the true champion is physical AI.

      The artificial intelligence startup Decart is pushing the boundaries of innovation with its latest live video model, Lucy 2.5, which introduces real-time streaming visual effects for the first time. The startup asserts that Lucy 2.5 is distinct in its ability to continuously generate AI visual effects on the fly and seamlessly integrate them into live videos as they are produced. This new capability allows media production companies and independent creators to effortlessly produce realistic fireballs, have characters exhale smoke, erupt into flames, or even inflate and explode at the touch of a prompt.

      The model promises Hollywood-level effects, constrained only by creativity, and eliminates the need for post-production work. Lucy 2.5 has the potential to significantly boost creativity, but its utility extends further. With its advanced understanding of complex physics and detailed visual effects, the model supports Decart’s broader ambitions in physical AI. Lucy 2.5 not only provides cinematic appeal but also functions as an engine that enhances accuracy in simulations used for robotics training.

      What’s new in Lucy 2.5?

      Decart has made substantial upgrades to the Lucy model since the launch of version 2 just five months ago. The most significant enhancement is the incorporation of realistic visual effects, allowing users to add explosions, fire, tsunamis, and thoroughly modify on-screen characters’ appearances, such as making them resemble a melting chocolate bar. Creators will have the freedom to invoke special effects as desired, with results that look much more realistic than those produced by previous versions, thanks to a refined physics engine and enhanced prompt adherence.

      Moreover, precision has improved. According to Decart, users now have greater control over the placement and behavior of AI-generated elements within live videos, and they can instantly remove any unwanted objects or characters without revealing signs of editing. These features collectively contribute to a much more realistic final product, available through the Decart API.

      Advertising and marketing are prime targets for Decart, as Lucy 2.5 allows users in these sectors to craft personalized promotional clips in real-time. Shopping experiences are also set to become more dynamic. No longer will consumers have to imagine how they might look in a new coat or dress. By linking Lucy to a camera and selecting an image of a product, users can see a hyper-realistic video showing how it would appear in reality, enhancing the prospects for immersive ecommerce virtual try-ons and in-store magic mirrors.

      A significant advancement for world models

      The debut of Lucy 2.5 marks another key achievement in Decart's rapid ascension over the past two years as a leader in AI video generation. Recently, all the necessary components have come together for Decart to position itself as a formidable competitor to other companies like Runway, Luma AI, Pika Labs, and Google. In December, Decart formed a partnership with Amazon Web Services, utilizing its Amazon Bedrock service and Trainium processors to offer Lucy as a plug-and-play product. In March, Comcast and Nvidia collaborated with Decart to develop a distributed AI grid utilizing Comcast’s nationwide edge architecture.

      This infrastructure enhancement laid the groundwork for the earlier release of Lucy 2, which was soon followed by an impressive $300 million funding round that concluded in May. With backing from Amazon's venture capital branch, Nvidia, Adobe Ventures, Atreides Management, Sequoia Capital, and others, Decart has not only solidified its status as a heavyweight in AI video but also as one of the most exciting innovators in the domains of world models and video compute infrastructure.

      World models are intricately linked to AI video, as they generate environments that can mimic physical, real-world settings, and Decart has made notable progress in this regard. With its powerful simulation engine, Oasis 3, the company has begun to make significant headway in robotics training, enabling developers of "physical AI" to hone systems that can safely navigate autonomous robots and self-driving vehicles in real-world scenarios.

      The introduction of Lucy 2.5 is expected to propel Decart’s world model initiatives forward, alongside expanding creative video production. The enhanced precision and visual effects of Lucy 2.5 stand to improve physical AI simulations in innovative manners. For instance, developers could evaluate how an autonomous vehicle operates in heavy fog when its camera feeds are compromised. Alternatively, they can design extreme scenarios to teach drones how to evade tornadoes or train robots to respond to explosions in industrial environments. By combining the capabilities of Lucy 2.5 with Oasis 3, Decart aims to create significantly more unpredictable and realistic training simulations.