LegendaryExplorer
LegendaryExplorer copied to clipboard
A Visual UI for FaceFX Like Animation Viewer OR a Text-to-Curve Interpreter
The Issue Animating with FaceFX currently is done by flying blind. In conventional animation environments, a face model is placed into a position, and then animation keys are generated by "snapshotting" where things are along the timeline. This allows for the manipulation of multiple phonemes/gestures at once and ensures everything works in tandem. Currently, a face must be animated by placing keys along one mouth shape at a time, and results can only be seen by navigating to the conversation in-game. Because of the non-visual nature of the editor and the visual nature of animation, this causes a real impediment for people, especially newer animators.
Describe the solution you'd like The current way of animating one thing at a time still works if results could be previewed. Because FaceFX Editor allows for the Import/Export of JSON files, something like Animation Viewer that allows for manipulation of facial animation and is capable of exporting a JSON file that could then be taken into FaceFX would be incredible. This app would only need to display a human head and allow the user to pick gestures and phonemes and place them in order.
Alternatives
A databank of typical phoneme keys specific to Mass Effect 3 could be created that work for certain sounds, or even entire words. This could be derived from existing ME3 lines. A text-to-curve model could be developed that exports a FaceFX JSON.
This could provide an excellent starting point that would require relatively minimal correction in FaceFX itself, especially if the ability to time the words or letters is implemented.
Additional context Very certain anything of this nature is a lofty goal, however, Animation Viewer is incredible and that was possible, so who knows!