Author Topic: Rio Davis  (Read 1336 times)

  • Administrator
  • Sr. Member
  • *****
  • Posts: 407
    • View Profile
Re: Rio Davis
« on: March 16, 2019, 09:04:51 am »
Rio sprite and chat is not ready to be controlled by XML file yet in the patch on Anonfile. I have it done already but I want finish more things before i upload current version.

I was thinking at the night how to utilize talking sprites better. The current version by Crow is implemented very crude Flash 1.0 style. The sprite contain long list of frames calling mouth to move to one of 9 jaw positions for a syllable as the sound is playing. Creating such frame sequence manually must have been extremely time consuming. There is no way we could do that this way even if we could get some females to record the speech.
However I can most likely make a function to control it easier way.

The realistic option is to make a function playing a line from XML file. A text line would contain characters identifying one of 9 syllables known by the sprite mouth. The function would play that character string by one character each frame. Or each 2 or 3 frames as there are 24 frames per second. The manual work would then be to create that line to be synchronous to played sound file. It can't be hard but I have to learn more about Flash to get skill to make this function. I'm still newbie to Flash.

The very challenging option is to make a function that plays mouth movement automatically based on sound file analysis as it's played.
It involves mathematical transformation of decoded MP3 sound, similar to spectral analysis. Then detection by convolution matrix multiplication into results. It's not that hard as it sound, I once have done simple inaccurate speech recognition as a 2 hour exercise task in Signal Processing class. But it was implemented in an appropriate tool, I can't imagine doing that in AS2 Flash. It would be really hard task if not impossible. I have no idea if there is even a way to access decoded MP3 audio in Flash.
« Last Edit: March 16, 2019, 09:22:32 am by Tabby »