Links and comments

I will demonstrate and discuss my work in computer facial animation and interactivity, describing techniques and projects. I will try to parallel my work with that of the industry. This can be broken down into 3 areas in historical order:

1) Research and development in 3D facial animation for film and TV

2) Linear and interactive facial work for interactive entertainment

3) Web based interactive facial work: Avatars to Agents

Early work at NYIT Computer Graphics Lab

See http://www.cs.cmu.edu/~ph/nyit/masson/nyit.html for more info on NYIT CGL

Video:

3DV & the Ant sequence - http://www.cs.cmu.edu/~ph/nyit/

– key framed character animation: robots

– early work on parameterized facial animation – Fred Parke http://www-viz.tamu.edu/faculty/parke/fip.html

– facial animation with video mapped lips

Fred Parke – father of facial animation

Kraftwerk 1987 - http://www.dipaola.org/steve/kraftwerk.html

First fully 3d music video

Fudicial cube approach to capture likeness

No real time playback – script based parameterized system

Scripts -> frames -> video tape

Dancers - http://www.dipaola.org/steve/dancers1.html

Hammer Sequence - http://www.dipaola.org/steve/hammer1.html

Face tests – Using façade, an interactive facial animation system –

based on Parke’s work - http://www.dipaola.org/steve/facade.html

Auto lip sync – also using façade with John Lewis auto-sync - http://www.idiom.com/~zilla/index.html - Research

Face based artwork - http://www.dipaola.org/steve/fineart.html

Electronic Arts

Managed a group that used their high-end 3D systems (SoftImage then Alias)

Video:

Facetest - http://www.dipaola.org/steve/watercolor.html

Dimitri auto lip sync - http://www.dipaola.org/steve/autolip.html

- used Alias and Soundstream

Onlive Face Based Avatars

Demo – talking, lip-syncing, emotive real-time face avatars on the web

Download and visit worlds as avatar - http://www.onlive.com

Siggraph Sketch Paper on Onlive - http://www.dipaola.org/sig99

Saatchi/Darwin – Web Character Agents

Palmtop – MS Agent web character for HP - http://www.hpresource.com/palmtop

Digital Biology - http://www.digitalbiology.com/contents/active_demos.html

Siggraph Panel on Web Characters - http://www.dipaola.org/steve/chartalk/characters.html

Maxis’ The Sims http://www.thesims.com

Facelift - http://www.dipaola.org/steve/facelift.html

Facespace - http://www.dipaola.org/facespace