Skyrim Modder Uses Language AI To Make NPCs More Immersive Than Ever
The modder Art From The Machine is currently testing a new project aimed at using ChatGPT to generate responses for the various NPCs in Skyrim VR, making the game world more immersive than ever before. The upcoming mod also makes use of xVASynth for text-to-speech and Whisper for speech-to-text interaction. With all three of these technologies in the game, NPCs are able to produce dynamically generated responses, answering questions and remembering interactions.
Some footage from the project made its way to YouTube in March, Art From The Machine providing a fairly substantial progress update earlier this week. “I am working on a Skyrim mod which allows for conversations with NPCs via ChatGPT, xVASynth (text-to-speech), and Whisper (speech-to-text). This update introduces Skyrim scripting which allows for lip syncing of voices and NPC awareness of in-game events,” the modder explains in the official description.
The video showcases Ulfberth War-Bear, a worker at Warmaiden’s in Whiterun, among several other NPCs. While the responses are of course a bit stilted, the mod carries incredible potential when it comes to creating dynamic interactions with NPCs. As soon as Art From The Machine finishes working on the brand new memory system, these will be able to remember past events and conversations, responding to players accordingly.
window.arrayOfEmbeds[“Gz6mAX41fs0”] = {‘youtube’ : ‘"<iframe allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/Gz6mAX41fs0" width="560"></iframe>"’}; window.arrayOfEmbedScripts[“youtube”] = “null”;
The mod is currently in active development, Art From The Machine planning to add more features and carry out extensive bug testing before releasing the project to the public. When this finally comes to fruition, the results will certainly be interesting to experience. The potential impact of such a system on the games industry remains to be seen, but similar to so many other technologies, the outcome could very well be in equal parts good and bad, something which goes for both creators and consumers. “This is an incredible, terrifying first step,” Adam Kemp for example commented on YouTube. “I love and fear this in equal measure.”
While many responses have raised concerns about the rise of AI, the overall reception to the mod has been extremely positive, potential players noting the practically limitless possibilities for the games industry going forward. “This is the first time that this use case of ChatGPT has come to my imagination,” Matt Krueger explained on YouTube. “I’m so excited for the future of gaming.”
Source: www.thegamer.com
