The Mona Lisa rapping? New Microsoft AI animates faces from photos
CNN
The Mona Lisa can now do more than smile, thanks to new artificial intelligence technology from Microsoft.
The Mona Lisa can now do more than smile, thanks to new artificial intelligence technology from Microsoft. Last week, Microsoft researchers detailed a new AI model they’ve developed that can take a still image of a face and an audio clip of someone speaking and automatically create a realistic looking video of that person speaking. The videos — which can be made from photorealistic faces, as well as cartoons or artwork — are complete with compelling lip syncing and natural face and head movements. In one demo video, researchers showed how they animated the Mona Lisa to recite a comedic rap by actor Anne Hathaway. Outputs from the AI model, called VASA-1, are both entertaining and a bit jarring in their realness. Microsoft said the technology could be used for education or “improving accessibility for individuals with communication challenges,” or potentially to create virtual companions for humans. But it’s also easy to see how the tool could be abused and used to impersonate real people. It’s a concern that goes beyond Microsoft: as more tools to create convincing AI-generated images, videos and audio emerge, experts worry that their misuse could lead to new forms of misinformation. Some also worry the technology could further disrupt creative industries from film to advertising. For now, Microsoft said it doesn’t plan to release the VASA-1 model to the public immediately. The move is similar to how Microsoft partner OpenAI is handling concerns around its AI-generated video tool, Sora: OpenAI teased Sora in February, but has so far only made it available to some professional users and cybersecurity professors for testing purposes.
Earlier this year, an 18-year-old high school senior from New York City had planned to enroll at Columbia University’s sister school Barnard College in Manhattan as an early decision student. But after her parents saw heightened tensions over the Israel-Gaza conflict surface across some US campuses, including at Barnard and Columbia, they went back to her list.