Unity announces new AI features: Unity Muse and Unity Sentis.

Unity has announced the launch of two AI tools aimed at transforming the creative process in gaming and real-time 3D applications: Unity Muse and Unity Sentis. Unity Muse is designed to speed up the creation process in the Unity Editor through natural input mechanisms such as text prompts and sketches. A key feature, Muse Chat, is currently in closed beta. This functionality enables users to access Unity documentation, training resources, and support content swiftly and accurately. Unity Muse will gradually offer more features, such as creating textures, sprites, and character animation.

Unity Sentis is an AI solution that facilitates the integration of neural networks into the Unity Runtime. Sentis, now in its closed beta phase, permits AI models to operate across different platforms where Unity functions, including mobile, PC, web, and popular game consoles such as Nintendo Switch and Sony PlayStation. This eliminates the need for cloud-based model hosting, reducing related complications, latency, and cost.

Unity is also introducing AI Verified Solutions to the Unity Asset Store, consisting of third-party packages that comply with Unity’s quality and compatibility standards. These solutions aim to boost the creative process, offering features like AI-powered smart NPCs, AI-produced VFX, textures, 2D sprites and 3D models, generative speech, and in-game testing with AI.

Unity Muse

Unity Muse is an AI platform that accelerates the creation of real-time 3D applications and experiences like video games and digital twins. The eventual goal of Muse is to enable you to create almost anything in the Unity Editor using natural input such as text prompts and sketches.

Now in closed beta: Muse Chat

A closed beta for Muse Chat is begun, a critical feature of the Muse platform. Using Muse Chat, you can leverage AI-based search across Unity documentation, training resources, and support content to get well-structured, accurate, and up-to-date information from Unity. Muse Chat helps you find relevant information, including working code samples, to speed up development and troubleshoot issues.

Over the next few months, you’ll see even more features in our Muse platform, including the ability to create textures and sprites or even fully animate a character, all using natural input.

This is just the beginning – Unity Muse will continuously improve to help you in the Editor and on the web.

This content is hosted by a third party provider that does not allow video views without acceptance of Targeting Cookies. Please set your cookie preferences for Targeting Cookies to yes if you wish to view videos from these providers.

Cookie settings

Unity Sentis

Unity Sentis is a literal gamechanger. At a technical level, it bridges neural networks with the Unity Runtime, but the possibilities that Sentis unlocks are near endless.

Now in closed beta

Unity Sentis enables you to embed an AI model in the Unity Runtime for your game or application, enhancing gameplay and other functionality directly on end-user platforms.

Sentis allows AI models to run on any device where Unity runs. It’s the first and only cross-platform solution for embedding AI models into a real-time 3D engine, so you can build once and embed your model so it can run on the edge on multiple platforms, from mobile to PC and web to popular game consoles like Nintendo Switch™ and Sony PlayStation®. Since you’re running your program on the user’s device, there’s no complexity, latency, or cost associated with model hosting in the cloud.

This content is hosted by a third party provider that does not allow video views without acceptance of Targeting Cookies. Please set your cookie preferences for Targeting Cookies to yes if you wish to view videos from these providers.

Discover more AI solutions

AI Verified Solutions is available– third-party packages that meet Unity’s highest quality and compatibility standards – on the Unity Asset Store. You can now find professional-quality AI solutions from providers such as Convai, Inworld AI, Layer AI, Leonardo Ai, LMNT, Modl.ai, Polyhive, Replica Studios, and Zibra AI. These new solutions enable AI-powered smart NPCs, AI-produced VFX, textures, 2D sprites and 3D models, generative speech, in-game testing with AI, and more, all designed to support and accelerate your creative process.

The company is encouraging user feedback on these new AI tools and their closed beta versions. It is also offering the Unity AI Beta Program for interested parties to keep updated about these AI offerings.