Challenges Of Facial Plastic Surgery In Computer Facial Recognition System
This paper aimed in identifying the challenges of recognizing a given face after aciurgy; in reality it is quite a challenging task to identify human faces which have under gone some corrections with computer algorithm. Surgery in face is considered as a challenging exploration issue in the field of face recognition, apart from the challenges of face recognition after aciurgy and feature works in this area are also highlighted to enable more exploration in this domain.
Keywords- aciurgy, human faces, computer algorithm, face recognition, Surgery.
The system of verifying/identifying faces is one among the few methods in biometrics system which gets the merits of high level of accuracy and non intrusive. It provides details about age, personal identity, gender, emotional state and the mood of a person. However, even after sometime of exploration, face stands as an active topic due to the changeability perceive in the facial appearance as a result of illumination, expression occlusion, pose etc. One among the new challenges of knowing human faces is facial aciurgy. Any face that passes through surgery alters the features to be used in knowing faces to a certain degree that human being got it hard to detect a person’s face after aciurgy. The statistical data has shown that aciurgy is growing (Signh, 2011). This is as because of technological increase, cheap, and the fastness in conducting the surgery, a lot of individual do undergo aciurgy not for passion but for medical reasons and others select cosmetic surgery to look younger and better by their appearance. The method can notably change the regions of a face for what ever type of surgery; alteration is done on the features and skin texture of a face. Again, as a result of privacy issues, the surgical details of a given face are not available and any aciurgy face database contains images before and after the face surgery. This further makes the extraction of feature difficult task in knowing human faces.
2.0 Understanding facial aciurgy
Knowing a human face by computer is called facial recognition is the ability of a computer system to recognize a test face in a given image, from gallery or video frame (Andrew 2015). It is becoming an area for wider exploration and application especially in the field of computer vision, access control, and investigation purposes. However when a given face undergoes surgery criminals or evaders hide their identities and resides in the society smoothly, which means the standard of face recognition is compromised making it an issue to be dealt with by the use of technology. Hence to overcome these trepidations, recognition of human faces by computer had to spread its tentacles and address this issue successfully (Pankaj et al., 2018). Plastic or cosmetic surgery can be defined as the process of altering a person’s appearance through specific procedures including liposuction, rhinoplasty, facelifts, and breast implant or augmentation (Singh R. et al. 2011). Although the facial surgery is advantageous for some it can be misused by some who have indulged in some kind of crime and wants to conceal his/her identity. Many countries have incorporated facial data into the electronic passport for security reasons. However, due to the aciurgy facial texture, shape and countenance can be altered and the security becomes unapt (Liu X. et al., 2013). In all type of aciurgy, there is one common thing that is all are gone through some kind of facial modification and diverge from the original. Aciurgy is broadly categorized into two (Pankaj et al., 2018). Local aciurgy: is mainly concern with correcting a portion in a face. Global aciurgy: concern with altering the entire structure of the face (Singh et al., 2011).
3.0 Related work
Traditionally, face recognition research has focused primarily on developing novel characterizations and algorithms to deal with challenges posed by variations in acquisition conditions like illumination conditions and head pose with respect to the camera. Tremendous success in dealing with these problems is probably one of the primary factors that has generated interest in new avenues in face matching that include matching faces across aciurgy variations. Although the main reason why people chose facial recognition system as the best among all other biometrics system is because it is non intrusive, the accuracy of facial recognition is usually affected by substantial intra-class variations due to some factors (Lin et al., 2009), including age, pose (Jiménez et al., 2009), lighting (Takallou and Kasaei, 2014), and expression (Yi. Et al., 2014). Most current works on facial recognition focuses on the efforts of minimizing the effect of such variations that could deteriorate the overall performance of system (Singh at al., 2009). However, a preliminary study on the effect of aciurgy on facial recognition was conducted, and they concluded that it is imperious for facial recognition systems to be able to tackle this significant matter, and that the research in this area is an imperative requirement (Singh et al., 2009). One of the first works related to recognizing faces after aciurgy from digital images studied how different categories plastic and cosmetic surgeries can affect the performance of a number of baseline facial recognition algorithms. They concluded that available facial recognition algorithms are not able to handle plastic surgeries that are classified as global procedures including, full face lift and skin resurfacing (Singh et al., 2010), a new approach to find the nearness between the pre plastic surgical face to the post plastic surgical face. They develop a classifier for facial images that have previously undergone some feature modifications through aciurgy based on near set theory. Their work concerned only geometrically obtained feature values and their approximation using near sets. Once the features will be extracted a feature database will be formed. Using this feature values near set theory provides a method to establish resemblance between objects contained in a disjoint set, that is it provides a formal basis for observational comparison and classification of the objects. One limitation to this approach is, it will recognize the face only after local aciurgy, but not work in the presence of global aciurgy (Signh 2011). A sparse representation approach combined with the popular sparse representation in 2012 was used to address the challenge of aciurgy variations and utilizes images from sequestered non-gallery subjects with similar local facial characteristics to fulfil this requirement. But still one limitation of sparsity-based biometric recognition is, it requires several images per subject in the gallery (Gaurav et al., 2012), not until 2013 where multiobjective evolutionary approach was developed to match face images before and after aciurgy. The algorithm first generates non-disjoint face granules at multiple levels of granularity. The first level of granularity processes the image with Gaussian and Laplacian operators to assimilate information from multiresolution image pyramids. The second level of granularity tessellates the image into horizontal and vertical face granules of varying size and information content. The third level of granularity extracts discriminating information from local facial regions. After features are extracted from that face granules by SIFT and EUCLBP algorithm. Then Multiobjective Evolutionary Approach is use to optimization of weight. Decision is take place on the basis of weight (Himanshu et al., 2013). Still in 2014 another approach was developed by Bhatt using analysis tools has not yield better result. A geometrical face recognition after aciurgy GFRPS system is proposed the recognition process is performed in three steps; localising the regions of interest ROIs of the ‘After’ image, measuring the geometrical distances between the ROIs centres to determine the post-geometrical features vector, and using a minimum distance classifier to compare the post-features vector with the pre-features vectors database to find the perfect matching. The main advantage of the proposed system is its simplicity besides its high performance. The experimental results reveal that the proposed technique achieves much higher face identification rate than the best known results in the literature beside its high robustness under different categories aciurgy procedures (Shaimaa and Hossam, 2014). This paper proposes an approach for recognition of such faces using PCA (Principle component analysis) for dimension reduction and LBP (Local binary pattern) for feature extraction from the facial region and periocular region (Pankaj, 2018).
4.0 Recent Challenges of face recognition after aciurgy
Facial aciurgy changes face appearance, which intuitively affects the robustness of appearance based face recognition. In this section, we analyze the effects of different aciurgy procedures on face appearance
4.0.1 Changes in skin texture:
Some aciurgy makes people look younger or more attractive by removing face scars, acnes or taking skin resurfacing. As a result, the skin texture will change.
4.0.2 Changes of Face Component:
The main face components: forehead, eyelid, nose, lip, chin and ear can be reshaped or restructured by aciurgy. The local skin texture around the face component may also be disturbed.
4.0.3 Changes of Global Face Appearance:
Global facial aciurgy will change the global face appearance, in other words, not only part of the face component and the skin texture will change, but also the whole face geometric structure and appearance will be disturbed. In summary, the challenges of face recognition after aciurgy mainly lie in the fact that faces after aciurgy have undergone various appearance changes, but no method is available to detect or model such changes. When an individual undergoes aciurgy, the facial features are reconstructed either globally or locally (Pankaj, 2018). Therefore, in general, aciurgy can be classified into two distinct categories.
4.1 Disease Correcting Local Aciurgy (Local Surgery)
This is a kind of surgery in which an individual undergoes local aciurgy for correcting defects, anomalies, or improving skin texture. Local aciurgy techniques can be applied for possibly three different purposes:
- To correct by-birth anomalies.
- To cure the defects that are result of some accident.
- To correct the anomalies that have developed over the years.
Examples of disease correcting local aciurgy would be surgery for correcting jaw and teeth structure, nose structure, chin, forehead and eyelids etc. Local aciurgy is also aimed at reshaping and restructuring facial features to improve the aesthetics. This type of local surgery leads to varying amount of changes in the geometric distance between facial features but, the overall texture and appearance may look similar to the original face. However, any of the local aciurgy procedures may be performed in conjunction with one or more such procedures and an amalgamation of such procedures may result in a fairly distinct face when compared to the original face.
4.2 Surgery for Reconstructing Complete Facial Structure (Global Surgery)
Apart from local surgery, surgery can be performed to completely change the facial structure which is known as full face lift. Global surgery is recommended for cases where functional damage has to be cured such as patients with fatal burns or trauma. Note that, global surgery is primarily aimed at reconstructing the features to cure some functional damage rather than to improve the aesthetics. In this type of surgery, the appearance, texture and facial features of an individual are reconstructed to resemble normal human face but are usually not the same as the original face. Furthermore, global plastic surgery may also be used to entirely change the face appearance, skin texture and other facial geometries making it arduous for any face recognition system to recognize faces before and after surgery. Therefore, it can also be misused by criminals or individuals who want to remain elusive from law enforcement and pose a great threat to society despite all the security mechanism in-place (Pankaj, 2018).
Most of the existing face recognition algorithms have predominantly focused on mitigating the effects of pose, illumination and expression, while the challenges of face recognition due to ageing and disguise still remains. As these procedures become more and more prevalent, future face recognition systems will be challenged to recognize individuals after aciurgy has been performed (Richa, et.al., 2008). In all type of aciurgy, there is one common thing that is all are gone through some kind of facial modification and diverge from the original fce; generally there are two main challenges to facial recognition after aciurgy (Pankaj, 2018).
- Due to the sensitive nature of the process and the privacy issues involved, it is extremely difficult to prepare a face database that contains images before and after surgery (Richa, et.al., 2008).
- After surgery, the geometric relationship between the facial features changes significantly and there is no technique to detect and measure such type of alterations (Richa, et.al., 2008). And facial recognition performance depends on facial features extracted.
5.0 Feature work
There are certain features of a face which cannot be altered even after aciurgy like the shape of the zygomatic bone, nodal points on the face and the pupillary distance (Pankaj, 2018). Now since the shape of zygomatic bone can not be change even if aciurgy is performed on a face there is likely tendency for feature facial recognition after aciurgy to work with features extracted from the face periocular region to perform recognition which can be used for future work, fusing matching scores for feature-based and texture-based algorithms using fusion techniques for robust facial recognition algorithms that can alleviate the effects of facial alteration.
Face recognition technique falters for the faces have undergone single or multiple plastic surgeries. But there are a few features which remain unaltered and not easy to be doctored. Our proposed technique is designed to use these features and successfully recognize faces which might have undergone surgeries. In the area of recognizing faces, many techniques have been introduced with the purpose of addressing the issues of illumination, pose, expression, ageing and camouflage. However surgery based face recognition is still a lesser explored area. These types of surgeries changes the facial features to such large extent that often human beings find it tedious to recognize a person face once the surgery is performed
- Amal S., Osman A., Vijanth S., Aamir M., and Azrina A., (2016). “ Proposed face recognition system after plastic suregry”, IET Computer Vision, vol. 10, pp. 342-348.
- Andrew E. (2015): “A Combination Approach to Face Recognition” Bishop’s University Sherbrooke, Quebec, Canada.
- Aruni S., Sanjay K., Shrikant T. S.,(2012). ”Comparison of face recognition algorithms on dummy faces”, The International Journal of Multimedia & Its Applications (IJMA) vol. 4.
- Jiménez, P., Nuevo, J., Bergasa, L.M., ‘Face tracking and pose estimation with automatic three-dimensional model construction’, IET Comput. Vis., 2009, 3, (2), pp. 93–102
- Lakshmiprabha N. S., Bhattacharya J., Majumder S., (2011) “Face recognition using multimodal biometric features”, International Conference on Image Information Processing (ICIIP), pp. 1–6.
- Lin, J., Ming, J., Crookes, D. (2009). “Robust face recognition using posterior union model based neural networks’, IET Comput. Vis., 3(3), pp. 130–142
- Liu X., Shan S., Chen X.,(2013). “Face Recognition after Aciurgy: A Comprehensive Study”, Computer Vision – ACCV, vol 7725, pp. 565-576, 2013.
- Singh, R., Vatsa, M., Noore, A.(2009). ‘Effect of aciurgy on face recognition: a preliminary study’. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops, 2009, CVPR Workshops 2009, 2009, pp. 72–77. Proc. Int. J. Comput. Vis., 2011, 6754, pp. 191–200
- Singh, K.R., Khedgaonkar, R.S., Gawande, S.P.,(2011). “A new approach to local plastic surgery face recognition using near sets”, Int. J. Eng. Sci. Technol., NCICT Spec. Issue, 5, pp. 71–75.
- Singh, R., Vatsa, M., Noore, A. (2011). “Effect of aciurgy on face recognition: a preliminary study”. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops, 2009, CVPR Workshops 2009, 2009, pp. 72–77. Proc. Int. J. Comput. Vis., 6754, pp. 191–200
- Singh, R., Vatsa, M., Bhatt, H.S., (2010).: ‘Aciurgy: a new dimension to face recognition’, IEEE Trans. Inf. Forensics Sec., 5, (3), pp. 441–448
- Takallou, H.M., Kasaei, S.(2014).”Head pose estimation and face recognition using a non-linear tensor-based model”, IET Comput. Vis., 8(1), pp. 54–65
- Yi, J., Mao, X., Chen, L., (2014). “Facial expression recognition considering individual differences in facial structure and texture”, IET Comput. Vis., 8(5), pp. 429–440