Augmented Reality » Harnessing the Power of AI: Meta’s New Video Face and Audio Voice Generators
AI Entrepreneurs

Harnessing the Power of AI: Meta’s New Video Face and Audio Voice Generators

Jun 19, 2023

Meta has recently unveiled two innovative AI tools: a video face generator called the MetaHuman Animator and Voicebox audio voice generator. These tools can generate convincingly realistic material based on a person’s face or voice samples.

The MetaHuman Animator captures an actor’s performance using an iPhone or a head-mounted camera system and then applies it as high-fidelity facial animation on any MetaHuman character. This technology is straightforward to use, requires no manual intervention, and produces results in minutes​1​.

On the other hand, Voicebox is a non-autoregressive flow-matching model trained on over 50,000 hours of speech. It outperforms existing models in tasks like text-to-speech synthesis, noise removal, content editing, style conversion, and diverse sample generation​2​.

While these tools open up new possibilities in content creation, they also raise concerns about the misuse of synthetic media. To address this, Meta has partnered with Microsoft to develop strategies to manage the risks associated with these new technologies.

Moreover, Meta plans to make more of its AI technology available as open source. This move not only promotes competition with tech giants like Microsoft and OpenAI, but also allows companies to leverage these advanced tools to build their own applications.

Key References:

  1. MetaHuman Animator – Unreal Engine
  2. Voicebox – Meta AI
  3. Open Source Initiative – The Information
  4. Partnership on AI

You might also be interested in these articles:

Navigating AI: Centaurs, Cyborgs & Work’s Future

Navigating AI: Centaurs, Cyborgs & Work’s Future

Recently, the question of AI's role in reshaping the future of work has gained prominence. A groundbreaking study led by a team of social scientists collaborating with Boston Consulting Group provides compelling insights into this debate. The results? AI, specifically...

read more