Wednesday, 22 January 2014

Thesis Abstract

Post No: 20 







Developing Methodologies for Parametric
Reconstruction of Human Face
in 3D Environment
Pravin Yadav
Symbiosis International University, Lavale, Mulshi, Pune 411 042, INDIA.


Key words: 3D face, physically based system, facial Reconstruction, facial modeling, anthropometry, anatomy, forensic science, tissue-depth thickness, face approximation
Abstract
In this paper, Researcher presents flexible and dynamic methodology to reconstruct human face which can be quickly adopted in any 3D environment. Proposed methodology is unifying approach that deals with translated inputs from various streams like anatomy, forensic science, and anthropometry. Proposed system imitates the physically based system that relies on anthropometric dimensions and tissue depth information. Proposed system also covers morphometric shapes along with anthropometric dimensions for all facial features. It is phase wise development approach (Section 2) and reinforced with concepts like Jeevak and Vyaktirekha (Section 2.2) which makes it faster and flexible.

1.      Introduction
The whole world population is increasing by every second. Within approximately 9”x 7”x 8” volume, we can see billions of variations. Another interesting fact is that the hardest part of our body teeth, softest and most flexible part tongue and lips and most reflective parts eyes, all find place in the face. Modeling these parts along with its properties is a great challenge. Information on human face is scattered in many fields, namely painting, sculpting, mathematics, anatomy, anthropology, forensic science, and computer animation. Each field has different concepts, processing style and techniques to deal with face study. It is important to address all the needs of various fields, deal with this multidisciplinary study and reconstruct a human face along with all its details.
To do this Researcher has developed a concept of AdarshMudra, Jeevak and Vyaktirekha, and has designed and developed a methodology along with the software system which does not require skilled personnel to reproduce/reconstruct an image of 3D human face from verbal, photo or x-ray inputs.


2.      Reconstruction Method
Researcher believes that human face can be thought of as a design pattern.

Fig. 1: Bayesian network for Human Facial feature placement and Face as Design pattern
Each feature is converted into parametric form. Parameterization is based on
v  Anthropometric Analysis (dimension) and
v  Morphological Analysis (Form and Shape)
Proposed philosophy embarks with Mudra phase in which generic facial 3D surface is created from AdarshMudra reference sketches. In PurnaMudra phase, 3D surface then morphed to specific face on the basis of reference input. Jeevak and Vyaktirekha concepts help to achieve correct facial proportion with local facial tissue depth. Further facial details can be added in ShilpaMudra Phase. Mutation of Face can be viewed in BhavMudra Phase. Thus a complex task of facial reconstruction is accomplished in simple phases.


 

















Fig.2 Phases comprised in Proposed Research Study

2.1 AdarshMudra (आदर्श मूर्धन् (Aadarsha muurdhan) – Sanskrit Word – Ideal Imprint)
AdarshMudra refers to building a template or generic face representing the Indian population. It confirms norms set by virtuosos and supports anthropometric dimensions of Indian population.

Fig. 3 Sketch for AdarshMudra

2.2 Jeevak and Vyaktirekha (जीवक (Jiivak) – Sanskrit Word – Living, व्यक्तिरेखा (Vyaktirekha) – Sanskrit Word – Features curve network) Vyaktirekha, features curve network defined by interconnected facial landmarks. Each Vyaktirekha point is a landmark point that confines anthropometric dimensions, anthropometric angles and dimensions. Jeevak is a topology defined by interconnected skull landmarks working as key points on human skeleton. Jeevak point may contain the cephalometric information and tissue depth information associated with related landmark, fat pocket, facial muscle direction and orientation. There will be corresponding Vyaktirekha point to hold the relationship. Jeevak point may not present for the facial features composed of soft tissues and cartilage.

Fig.4 Jeevak and Vyaktirekha Concept  
Jeevak and Vyaktirekha will be implemented using bone based method that uses joint and skinning to connect facial mesh and skull mesh. Eventually facial mesh can be derived from layered approach comprising lattice manipulation, forward skeleton kinematics, smooth skin binding and shape interpolation.
Proposed system attempts to deliver a facial 3D surface based on verbal explanation and/or front/lateral photographs and/or Cephalogram or 3D scanned data. Obviously, accuracy of output surface reflects the correctness and calibration of input.  Proposed system can be viewed as fast facial modeling framework for modeler in entertainment industry, 3D face visualization tool for a forensic expert, 3D simulated facial surface for surgical planning and quick sketching 3D canvas to generate face from explanation for police. 3D Facial model can be used be used as interactive tutor to teach medical students.

3.      Experimental Results






































4.      Future work
Proposed system can be enhanced with more features listed below:
                    i.      Skin texture, can be extracted from the photographs. The skin shader for facial surface can be developed with various maps to give exact look of an individual.
                  ii.      Hairstyle and Haircut can also be added as separate module and will enhance the results.
                iii.      Although current study limits facial variation of Adult Caucasian male of Indian origin, in future it can be extended to female, wider age group and for other races and sub races. Detailed morphometric analysis of each feature and its conversion into various blend shapes will enhance the quality of the system.
                iv.      Facial surface response to dental rearrangement can be explored in future. Orthodontic, surgical operations may be simulated on 3D face to predict implications.

5.      conclusions
The proposed system presents unified path of understanding the human face from various streams ranging from art to science and builds a common channel for information exchange. System can work on the basis of vague verbal explanation or precise input and attempts to deliver the output. The process is comprised of phase wise development and presents dynamic and flexible method for facial reconstruction in 3D environment.
References:
1.       Chakrabarti D., Indian Anthropometric Dimensions For Ergonomic design practice, National Institute of Design, Paldi, Ahmedabad
2.      Chaurasia BD., Human Anatomy Volume Three, Head, Neck and Brain, Third Edition, CBS Publishers and Distributors, New Delhi, India, 2003, pp 1-30, 36-47, 193-196, 211-212, 215-216, 229-230, 234-235
3.      Clement JG., Marks MK., Computer Graphic Facial Reconstruction, Elsevier academic press, USA, 2005, pp 20-23, 35-42, 129-141, 183-195, 221-236
4.      Cordea MD., Petriu EM., “A 3-D Anthropometric-Muscle-Based Active Appearance Model”, IEEE Transactions on Instrumentation and Measurement, Vol. 55, No. 1, Feb 2006
5.      DeCarlo, D. Metaxas D. and Stone M.,“An Anthropometric Face Model using Variational Techniques”, Department of Computer and Information Science, University of Pennsylvania, SIGGRAPH ’98.
6.      Fairbanks AT., Fairbanks EF. Human Proportions for Artists, Washington, USA, Fairbanks Art and Books, 2005, pp 101-110, 136-137, 164.
7.      Gould D., Complete Maya Programming Volume I, Morgan Kaufmann Publishers, 2005
8.      MacKay J., Forensic Art, Lucent Books, Farmington Hills, MI, USA, 2009, pp  8-58
9.      Sahni D., Sanjeev, Singh G., Jit I., Singh P., Facial soft tissue thickness in northwest Indian adults Forensic Science International, Volume 176, Issue 2, Pages 137-146,
10.  Taylor KT., Forensic Art and Illustration, CRC Press, Boca Raton, Florida, 2000, pp 49-72, 93-106, 341-356, 419-452
11.  Wilkinson C., Forensic Facial Reconstruction, University of Manchester, Cambridge University Press, UK, 2008, pp 69-78, 102-119, 124-146, 200-209

Tuesday, 17 December 2013

Ph.D., another milestone achieved

Post No 19:









Research Topic: Developing Methodologies for parametric reconstruction of Human Face in 3D Environment

A multi-disciplinary research to recreate human face in 3D, an effort to reproduce individual's face from verbal explanation, photographs or skeletal remains. This comprehensive work may give a name to a dead, find a criminal, help surgeon to visualize surgical modifications or anybody to sculpt human face without artistic and technical skills. This research will empower every individual who deals with human face.



While walking towards stage, I was thinking. This Research would not have been possible without the guidance of my thesis guide, Prof.T.M. Kanvinde. 
I want to express my gratitude to all those individuals in various walks of life who shared their time and knowledge discussing with me on human face. Without their perspectives, this study would not have enriched with so many dimensions. — at Symbiosis International University, Lavale.

A long cherished wish that came true. 

Receiving Ph. D. degree from Dr. M.M. Pallam Raju, Hon'ble Minister for Human Resource Development, Government of India.

With my proud family, wife Samiksha Yadav, daughter Diya Yadav, bro Skekhar Yadav, niece Rohini. Credit must also go to Samiksha and Diya for keeping smile on their face, though I snatched their joyful time to adorn my study.

I lovingly dedicate my degree to my mother. 
Mummy, words can never express the deepest gratitude I have for you.

The 2013 Ph.D. Awardees (Standing first row, in white graduation robe) pose for a souvenir photo with Chief Guest, Dr. M.M. Pallam Raju, HRD minister,(seated, forth from left), Dr. Rajani Gupte, Vice Chancellor, SIU, (seated, sixth from left) ,Dr. S. B. Mujumda, Chancellor, SIU. (seated, fifth from left). Myself (Standing first row, fifth from left,in white graduation robe).

and thus another milestone achieved.
A Knowledge-seeker's journey is very funny and mysterious. The moment one goal is achieved, it disappears and another appears ... distance apart, high up on mountain top. Fanatic, curious mind gets off for another expedition. A new mission, again relentless efforts, sleepless nights, rising frustration, craving and yearning for success.
For a layman, it might look very confusing. For him, ignorance is bliss and unknown is fate. 
For a knowledge-seeker, it is the question of existence. For him, goal is to solve every single riddle in the universe. Analyse, discern, understand all mystical real and unreal facts, transfer each entity from unknown to known pocket. The ultimate mission is simple, to understand the truth.
In spite of knowledge is finite and truth is infinite, the saga continues....

Friday, 1 November 2013

Caricature: Abraham Lincoln

Post No: 18





Caricature of Abraham Lincoln, the most famous president of the United States by various artists   
by Jeason Seiler
By Rocksaw

By Robolus

by Court Jones
 
 by Ismael Roldan  

 
By Stuart Kim
By donkeyhotey

Wednesday, 23 October 2013

Quote by Oscar Wilde

Post No: 17










Quote by Oscar Fingal O'Flahertie Wills Wilde (16 October 1854 – 30 November 1900)
simply Oscar Wilde.




Friday, 11 October 2013

Face Geek: Paul Ekman- Facial Expression Expert

Human Face by Dr. Pravin Yadav
Post No: 16 

Pauk Ekman, an emeritus professor at the University of California at San Francisco. Born in 1934, relentlessly worked on emotions and Facial expressions, now considered as one of the most eminent psychologists of this era. He is master face reader with tremendous knowledge of nonverbal behavior and interpersonal deception. Paul explored that few basic facial expressions and their corresponding emotions are independent of culture and universal to all humans and preemptively biological as hypothesized by Charles Darwin.  
Paul reported facial microexpressions  that could be used to reliably detect concealed emotions. CIA and FBI is seriously implementing his ideas in lie detection while interviewing terrorists, criminals. His greatest contribution is Facial Action Coding System, is the most exhaustive analysis of all the facial expressions. According to Paul, the basic facial expressions with distinct facial signals are 
  1. SADNESS 
  2. SURPRISE
  3. ANGER
  4. CONTEMPT
  5. DISGUST
  6. FEAR
  7. HAPPINESS
Paul Ekman authored several books on facial expressions, some of them are listed below:
   
  











In his book "Unmasking the face" Paul explains how to identify these basic emotions correctly and how to tell when people try to mask, simulate, or neutralize them. In his video "The Art of Deciphering Facial Expressions" demonstrates 'micro-expression'.


His research made a tremendous contribution to the field of clinical psychology, law enforcement, counter-terrorism and crowd management. Please follow this link to read his biography and his research.

Friday, 4 October 2013

Human Face: Robots with ultra real human face

Human Face by Dr. Pravin Yadav
Post No: 15 










Can you checkmate a creative scientist?...
One fine day a scientist told his wife I saw a lady, looked exactly like "YOU" and 
wife asked, "Was she hot ..??"
That moment scientist was checkmated, couldn't reply "Yes" or "No".
But probably that triggered a great idea..and he bounced back.

Can Robot become potential life partner if that has ultra real human face?
Let's check that.
Japanese roboticist Hiroshi Ishiguro 
Humanoid robots called 'Nao' from the French robotics venture Aldebaran demonstrate their skills during a display at the French Embassy in Tokyo. Aldebaran is providing 30 Naos to Tokyo University for use in an educational program.



David Hanson identifies himself as sculptor-roboticist
David Hanson has turned it into his mission to bring robots to life, attempting to enable them to think and feel. 


The lady in picture in the center is wearing The REALFACE, not a computer graphic image.
The "three-dimension Photo Form (3DPF)" technique from Real-f makes it possible to duplicate pores, eye's blood vessels and iris exactly the same as the originals.
Check few more "THE REALFACE" high resolution samples.


http://www.cbsnews.com/2300-205_162-10007199.html
A model (R) pokes the face of a humanoid robot called 'Geminoid-F' (L) shaped to resemble the model. Geminoid-F, designed and built by Osaka University professor Hiroshi Ishiguro and Japan's robot maker Kokoro, is equipped with 12 actuators, powered by air pressure, and her motion can be synched to imitate that of a real human being.

Check this report on Robot Faces Trigger An Emotional Choice. 
This is just a beginning, we have just triggered the creative mind ...there is lot more to come

Monday, 30 September 2013

Identical Twins and Recognition.

Human Face by Dr. Pravin Yadav
Post No 14:
Human Face >> Science >> Biology >> Genetics








Identical Twins are not clones but result of single fertilized egg splitting into two separate embryos. In scientific terms it is referred as monozygomatic. 

It becomes very difficult to identify subtle differences that differentiates mirror like individual. If you really want to stress your identification skills then you must visit Twins Days Festival in Twinsburg, Ohio. 
Facial variation in genetically identical twins can be exaggerated by engaging them in separate environmental conditions.


A famous book Identical: Portraits of Twins By Martin Schoeller (Author) 

Curious mind raises many questions such as, Can Biometrcs ID an Identical Twin?
But it is found that sometimes many twin faces confound various Facial Recognition software. The best performing algorithm has 17-18 percent equal error rate which should be  under 5 percent. Still, Scientists are studying relentlessly to solve this riddle. One of the paper is "Analysis of Facial Features in Identical Twins" by Brendan Klare, Alessandra A. Paulino, and Anil K. Jain. 
Although, Close friends and even Mom and Dad can be duped by their identical twins, But interesting fact is they can't dupe dogs? and they also have different fingerprints. Also, as identical twins get older, generally more differences in physical characteristics develop.