#1
|
|||
|
|||
HD complete characters speaking naturally
We're thinking of buying the HD complete character set. One very interesting features of these characters would be the facial expressions. I'm especially interested in making the characters speak more naturally (the lipflapping of vizact.speak() is far from optimal for conversational agents). Is it possible to let the HD characters speak with phonemes (see http://www.karisproductions.com/wp-c...neme-Chart.jpg)? If so, how would you extract phonemes from a wav-file (or a sound in another format), so that the HD characters gets the information which lip movements to make to speak realistically? Would you need the Microsoft Speech API for this?
Most important question: could we test this with the HD complete character that comes with Vizard4? |
#2
|
|||
|
|||
Hi Frank,
Our characters are not currently set up with phonemes included, though these could be created either as morph targets or with the included facial bones. Third-party programs exist for extracting phonemes from audio files, though I don't have any experience with them. One I have seen recommended is CMUSphinx. I also wouldn't be surprised if a python library exists that allows phonemes to be detected in real time. |
#3
|
|||
|
|||
To clarify, the VCCHD set has expressions and phoneme pose files (both in .bip and .cpy) that can be loaded onto the skeletons in Max. As of this moment they are not currently part of the exported versions of the avatars. It may be worth adding them to the DVD build.
The phonemes included as pose files are: Quote:
Quote:
|
#4
|
|||
|
|||
Hi Valeno,
Thanks for the response! It sounds like (no pun intended) the VCCHD set has all the ingredients to create a naturally speaking avatar, when phonemes are extracted from a .wav file. Too bad none of them are included with the standard character that comes with Vizard. I noticed that the HD example character does not have any morphs It would be a good idea to include the different poses in the exported versions of the avatars on the DVD build! I also work with FaceGen, which includes similar morphs for the phonemes, so I will test those. If I can make those phonemes work, I think we can also get the VCCHD characters to speak properly. Regards, Frank |
Tags |
hd complete characters, microsoft speech api, phonemes, speak |
Thread Tools | |
Display Modes | Rate This Thread |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Complete Characters HD and speech | Enlil | Vizard | 1 | 06-01-2011 06:16 PM |
Complete characters and heads | Vkathrynr | Vizard | 1 | 08-27-2009 11:09 AM |
adding 3D heads to complete characters | Vkathrynr | Vizard | 2 | 08-19-2009 09:16 PM |
How to add individual faces onto the complete characters used in Vizard? | VDong | Vizard | 3 | 11-12-2008 11:05 AM |
How to cut out the heads of the complete characters? | VDong | Vizard | 2 | 09-26-2008 06:27 PM |