Skip to the content Skip to the Navigation

Irfan Essa

  • Home
  • Blog
  • Publications
  • Team
  • Videos
  • Teaching
  • FAQ
  • Contact
Blog
  1. HOME
  2. Blog
  3. August 1994

August 1994

August 30, 1994 / Last updated : March 2, 2021 irfan Thesis

Thesis: Irfan Essa’s PhD Thesis (1994): “Analysis, interpretation and synthesis of facial expressions”

This thesis describes a computer vision system for observing the “action units” of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial patterning of facial shape and a parametric representation of the independent muscle action groups responsible for the observed facial motions. These muscle action patterns are then used for analysis, interpretation, recognition, and synthesis of facial expressions. Thus, by interpreting facial motions within a physics-based optimal estimation framework, a new control model of facial movement is developed. The newly extracted action units (which we name “FACS+”) are both physics and geometry-based and extend the well-known FACS parameters for facial expressions by adding temporal information and non-local spatial patterning of facial motion.

Recent Posts

Paper in UIST 2021 on “Automatic Instructional Video Creation from a Markdown-formatted Tutorial”
October 12, 2021
Paper in ACM CHI 2021 on “Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup Videos”
February 25, 2021
Research Opportunities at Google Atlanta
February 15, 2021
Paper in AAAI 2021 on “Semantic MapNet: Building Allocentric Semantic Maps and Representations from Egocentric Views”
February 2, 2021
Paper in ACM UIST 2020 on “Automatic Video Creation From a Web Page”
October 28, 2020
Paper in ECCV 2020 on “Neural Design Network: Graphic Layout Generation with Constraints”
August 25, 2020
Panel of ML@GT Researchers working on Covid-19 Relief
June 24, 2020
Invited Speaker at CVPR 2020 Workshop on “AI for Content Creation”
June 15, 2020
Paper in ICLR 2020 on “DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames”
April 27, 2020
Keynote Speaker at CNS/AANS Spine Summit 2020, Las Vegas, Nevada, March 6, 2020, on the topic of “Data-driven Innovation”
March 6, 2020

Tags

ACM (23) Activity Assessment (5) Activity Recognition (52) Affective Computing (9) Artificial Intelligence (18) Audio Analysis (9) Awards (11) Aware Home (17) Behavioral Imaging (11) Best Paper Award (8) Computational Journalism (43) Computational Photography (67) Computational Video (70) Computer Animation (10) Computer Graphics (9) Computer Vision (107) Crowdsourcing (8) CVPR (27) DVFX (10) Events (9) Faces (12) Funding (7) Gesture (7) Google (15) HCI (6) Health (7) ICCV (8) IEEE (30) Machine Learning (30) Medical (10) News (21) NSF (17) NSF-0205507 (10) PhD Thesis (14) Presentations (29) Robotics (7) SIGGRAPH (8) Sports Visualization (6) Teaching (22) Ubiquitous Computing (5) Video Segmentation (7) Video Stabilization (14) Video Textures (5) WACV (7) Wearable Computing (7)

More about this Website

  • About
    • Tags & Categories
    • Archives
    • Copyright
    • Privacy Policy

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Copyright © Irfan Essa All Rights Reserved.

Powered by WordPress with Lightning Theme & VK All in One Expansion Unit by Vektor,Inc. technology.

MENU
  • Home
  • Blog
  • Publications
  • Team
  • Videos
  • Teaching
  • FAQ
  • Contact
PAGE TOP