Full Body XR and Lipsync

Unity
1

Has anyone been able to integrate Lip Sync with the Full Body XR avatars?

The OVR Lip Sync Context Morph Target requires that the skinned mesh renderer implements the viseme blend shapes. Those blended shapes don’t seem to be available in the XR avatars.

2

I figured it out. You have to request the blended shapes for viseme when you load the avatar - either using the avatar config or in the morphTarget parameter of the url.

3

That makes sense! If you’re working with viseme-based lip syncing, requesting blended shapes for visemes when loading the avatar ensures that the correct morph targets are available for animation.

For others who might run into a similar issue:

  • Using Avatar Config: Ensure that the viseme blend shapes are enabled when configuring the avatar.
  • Using URL Parameters: If loading the avatar via a URL, specify the morphTarget parameter to request viseme shapes.

Great troubleshooting! Are you implementing this in a specific engine like Unity, Unreal, or a web-based framework? :rocket: