To install StudyMoose App tap and then “Add to Home Screen”
Save to my list
Remove from my list
A novel approach to extract the light invariant local feature for facial expression recognition is presented in this paper. It is robust in monotonic gray-scale changes caused by illumination variations. Proposed method is easy to perform and time effective. The local strength for a pixel is calculated by finding the decimal value of the neighboring of that pixel with the particular rank in term of its gray-scale value among all the nearest pixels. When eight neighboring pixels are considered, the gradient direction of the neighboring pixel with the mix of second minima and maxima of the gray scale intensity can capture more local details and yield the best performance for the facial expression recognition in our experiment.
CK+ dataset is used in this experiment to find out the facial expression classification. The classification accuracy rate achieved is 92.1 ± 3.2%, which is not the best but easier to compute. The results show that the experimented feature extraction technique is fast, accurate and efficient for facial expression recognition.
Human facial expression is an important role in human-to-human contact.
Verified writer
Proficient in: Science
5 (893)
“ Thank you so much for accepting my assignment the night before it was due. I look forward to working with you moving forward ”
It allowing people to communicate each other beyond the verbal world and understand each other from various modes. Some expressions helps human for actions, and others enhance the interaction meaning. Human computer interfaces must detect crucial changes in the user’s behavior than simply responding to the user’s instructions. Facial expression recognition is a challenging field in human computer interaction, human computer interface and computer vision. Due to its prospective vital applications, many young researchers chose this area as their research interest (Z.
Zeng et al, 2009). Among the different methods, appearance-based methods have been heavily employed in this research field with huge success. Some of them are LGP- local gradient pattern, LMn- local minima, LTP-local ternary pattern, Gabor filters, local binary patterns (LBP) descriptors, Haar wavelets and subspace learning methods. A. Mehrabian (1968) wrote in his paper that the verbal part of a communication contributes only 7 percent of its overall meaning, the voice part helps 38 percent while facial movement and the expression helps 55 percent of the meaningful communication.
This highly meaningful expression has seven basic subdivisions:
MA. Peter et al. (2018) developed a instrument called Product Emotion Measurement instrument (PrEmo), which can detect many emotion types. It is found in many past research papers that most of the facial expression recognition systems (FERS) are based on the Facial Action Coding System (FACS), Y.L. Tian et al. (2001), Y. Tong et al. (2007), M. Pantic et al. (2000). 44 different action units (AUs) are formed using FACS is above research papers. Up-to 7000 dissimilar combinations are possible using these AU's, with wide variations of human e.g. age, size and ethnicity. M. Pantic et al. (2000) compared many methods on facial expression recognition. Still images are easy to obtain and good for initial learning. This is a reason for young researchers to choose still image data sets.
One of the psychological experiment by J.N. Bassili (1979) has proposed that facial expressions are recognized better with higher accuracy from video. His research encouraged many researchers to work with video than still images. I. Kotsia et al. (2007) created a facial wire frame model from still image in their paper which can capture more details but takes more space and also slower than some other methods. Y. Zhang et al. (2005) introduce a novel way by using IR camera to capture facial features in details. Y.L. Tian et al. (2001) experimented on multi state face components and created a model of multi state AUs which was classified by neural network. M. Yeasin et al. (2007) enhanced the Markov model for facial expression recognition. K. Anderson et al. (2006) used video as dataset and created a model named the multichannel gradient model (MCGM) to find the facial optical flow.
The motion signatures obtained from the MCGM are then used as input for Support Vector Machines to classify. I. Cohen et al. (2003) also worked on videos. They used Naive–Bayes as classifier and hidden Markov models (HMMs) to collect facial expression features. M. Pantic et al. (2006) tried contour tracking and rule-based analysis to find 20 AUs from facial front view and side view. T. Ahonen et al. (2006) proposed a facial expression recognition model using Local Binary Pattern (LBP). The original LBP operator by T. Ojala et al. (1996), compares each pixel with the center pixel value in a 3x3 local area and transforming the result as a binary number.
Experiments using FACS are more complex while the appearance-based calculations are less complex. Hence, a new and easy appearance-based feature extraction method is experimented in this paper that would be more efficient for facial expression recognition.
Images are converted into gray scale first. From the image 3x3 region, shown in Fig. 2, is taken at a time. The center pixel of the region is surrounded by 8 neighboring pixels. The position of the neighboring pixels with the minimum in value and maximum in value can be considered as the local feature for the given center pixel. In the previous work, MS. Islam et al. (2013), only the minima was considered. In Fig. 2, a(1) pixel is in position 1, a(2) pixel is in position 2 and so on. Each position is considered as a bin. E.g. Bin 1-8. Therefore if the pixel at position 1 e.g. a(1) has the minimum/lowest gray value among a(1-8) pixels, bin-1 will be increased by one. Similarly another eight bins for the maxima starting from bin-9 to bin-16. A(3)=25 is the minimum in gray value and a(1)=253 is the maximum in gray value. Therefore bin-3 and bin-9 will be increased by one for pixel 240. Similar way local feature is extracted for each pixel of the image.
The full experimental setup is subdivided into three steps:
All through the experiment, the Extended Cohn-Kanade Dataset (CK+) (P.Lucey et al., 2010) is used. There are 123 subjects and 326 peak facial expressions of those subjects. The expressions in this dataset are subdivided into 7 categories, Anger, Contempt, Disgust, Fear, Happy, Sadness and Surprise. Each subject has several same expression but for the experiment it is collected only once.
Expression Numbers of instances:
Facial feature calculation phase is shown in Fig. 5. In the experiment fdlibmex, a free code for Matlab is used for face detection. Face is then resized into lower resolution to ease the calculation. Also masked to remove unnecessary area, thus the calculation get less and more easier. The 180x180-sized masked face (3rd block of Fig. 5) is subdivided into 9x9=81 blocks of 20 by 20 pixels each. Proposed method is used for feature calculation. The histogram of all the blocks are concatenated into a unique feature vector. Therefore, the length of the feature vector is (8+8)x9x9= 1296. LIBSVM, by C.C. Chang et al. (2011) is trained using feature vectors of all images in the training phase. Using multiclass SVM module, a 10-fold cross validation is performed.
The achieved classification accuracy rates. The 2nd minima (LMn-2) and the 1st maxima (LMx-1) resulted better with accuracy of 92.1%±3.2. This is obtained by averaging the accuracy of 10-fold cross validation. The maximum accuracy resulted by any fold from the ten folds is 94.8% and the minimum is 89.4%. Same experiment is performed with different block sizes. Though the block size of 15x15 pixels gives the highest accuracy rate but there is a penalty in feature vector length.
| Local Minima | Local Maxima | Classification Accuracy |
|---|---|---|
| 1st (LMn-1) | 1st (LMx-1) | 89.8%±3.2 |
| 1st (LMn-1) | 2nd (LMx-2) | 91.1%±3.2 |
| 1st (LMn-1) | 3rd (LMx-3) | 88.8%±3.2 |
| 1st (LMn-1) | 4th (LMx-4) | 91.9%±3.2 |
| 1st (LMn-1) | 5th (LMx-5) | 88.9%±3.2 |
| 1st (LMn-1) | 6th (LMx-6) | 90.2%±3.2 |
| 1st (LMn-1) | 7th (LMx-7) | 90.5%±3.2 |
| 1st (LMn-1) | 8th (LMx-8) | 91.4%±3.2 |
| 2nd (LMn-2) | 1st (LMx-1) | 92.1%±3.2 |
| 2nd (LMn-2) | 2nd (LMx-2) | 90.1%±3.2 |
| 2nd (LMn-2) | 3rd (LMx-3) | 91.8%±3.2 |
| 2nd (LMn-2) | 4th (LMx-4) | 90.9%±3.2 |
| 2nd (LMn-2) | 5th (LMx-5) | 91.9%±3.2 |
| 2nd (LMn-2) | 6th (LMx-6) | 90.2%±3.2 |
| 2nd (LMn-2) | 7th (LMx-7) | 89.5%±3.2 |
| 2nd (LMn-2) | 8th (LMx-8) | 89.4%±3.2 |
Due to different experimental setups and version differences of the CK (T. Kanade et al., 2000) dataset , the results are not in a straight line comparable. L.A. Jeni et al. (2012) mentioned in their research that straight aligned faces can give an extra 5% to 10% boost in the expression classification accuracy. Leave-one-subject-out type validation can boost the accuracy by another 1-2% , (M.S. Bartlett et al., 2003).
A novel local appearance based facial feature extraction method for human expression recognition in experimented in this paper. It obtains some crucial features from a gray scale image. The neighboring pixels with local minimum and maximum value on the gray scale color are used to identify those local features for the pixel in the center. Eight possible minima and eight possible maxima can be considered as a local feature for a given pixel; however, the second minima along with the 1st maxima results the highest recognition in the experiment. As its simplicity, it can be incorporated with other boosting methods to increase the accuracy of recognition.
Facial Expression Recognition Under Variable Illumination: A Local Descriptor Approach. (2024, Feb 17). Retrieved from https://studymoose.com/document/facial-expression-recognition-under-variable-illumination-a-local-descriptor-approach
👋 Hi! I’m your smart assistant Amy!
Don’t know where to start? Type your requirements and I’ll connect you to an academic expert within 3 minutes.
get help with your assignment
