隨著資訊科技的蓬勃發展，目前的安全需求也越來越受重視。身分辨識系統也朝著資訊化和網路化的方向發展。在多種生物辨識模式中，人臉辨識作為生物特徵其擁有取像簡單、無需接觸即可完成的優點，故其為主流的辨識方法之一。
本論文透過區域分析(Local Feature-Based)之方式，將所取得之高解析度正規化人臉影像進行特徵擷取。接著透過特徵點偵測，動態建置出臉部加權矩陣，最後以加權式卡方檢定分別計算影像間之相異度，取得最終辨識結果。
當人臉辨識系統架構完成後，本論文擬將之與近場通訊(Near Field Communication)進行結合，建造一行動支付費系統。本論文將以人臉辨識作為主要驗證系統，輔以身分金鑰以及行動裝置序號，並提出一種加密機制，於完成人臉辨識後，透過網路將金鑰送至遠端伺服器進行驗證，成功取得許可權後，始可使用NFC架構進行卡片模擬，進而使用行動付費或門禁刷卡等功能。

According to the information technology has grown so fast nowadays, the need of information security has caught people’s eyes. Besides, the mobile devices penetration also increases a lot every year. Thus, more and more people have paid attention on the researches of using biometric features to identify human people.
In many kinds of biometrical recognition methods, face recognition has outperformed others because it is contactless and easily to capture face image. However, face recognition rate still affects by some environment elements such as light conditions and facial expression. Therefore, locates the face location accurately and reduces the impacts of environment elements is the major challenges in the research field.
In order to improve the recognition rate, this thesis extracts the image features by using Local Texture Pattern. Because the edge information is well considered, the extracted feature will be much more exhaustive than usual. Also, the image’s feature points will be detected. According to those points, the image weight array can be constructed. Finally, Weighted Chi-square dissimilarity measure will be used to compute the similarity score between two images.
After the face recognition process, we proposed to build a hybrid mobile payment system by adding Near Field Communication into it. Face recognition will be the main structure of the whole system while traditional passwords will be used as second security process. Once the face is correctly recognized, users will need to insert personal ID Key and then all these information will be encrypted and sent to cloud server for verification. If the verification result is positive, the mobile device will finally be able to execute NFC card emulation and do paying.

[1] 財團法人資訊工業策進會: “智慧型行動裝置普及率近7成 市場即將飽和! ”, 2014, http://www.iii.org.tw/m/News-more.aspx?id=1475
[2] Amjad, A., Griffiths, A., Patwary, M.N.: “Multiple face detection algorithm using colour skin modelling”, Image Processing IET, 2012, vol. 2, issue. 8, pp.1093-1101
[3] Sagheer, A., Aly, S.: “An Effective Face Detection Algorithm Based on Skin Color Information”, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems (SITIS), 2012, pp.90-96
[4] Kang-Seo Park, Rae-Hong Park, Young-Gon Kim: “Face detection using the 3×3 block rank patterns of gradient magnitude images and a geometrical face model”, 2011 IEEE International Conference on Consumer Electronics (ICCE), 2011, pp.793-794
[5] Wei Chen, Tongfeng Sun, Xiaodong Yang, Li Wang: ”Face detection based on half face-template”, 2009. ICEMI '09. 9th International Conference on Electronic Measurement & Instruments, 2009, pp.4.54-4.58
[6] Wang Jizeng, Yang Hongmei: “Face Detection Based on Template Matching and 2DPCA Algorithm”, 2008. CISP '08. Congress on Image and Signal Processing, 2008, vol. 4, pp.575-579
[7] Amaro E.G., Nuno-Maganda M.A., Morales-Sandoval M.: “Evaluation of machine learning techniques for face detection and recognition”, 2012 22nd International Conference on Electrical Communications and Computers (CONIELECOMP), 2012, pp.213-218
[8] Mallipeddi, R., Minho Lee: “Ensemble based face recognition using discriminant PCA Features”, 2012 IEEE Congress on Evolutionary Computation (CEC), 2012, pp.1-7
[9] Puyati, W., Walairacht, A.Z: “Efficiency Improvement for Unconstrained Face Recognition by Weightening Probability Values of Modular PCA and Wavelet PCA”, 2008. ICACT 2008. 10th International Conference on Advanced Communication Technology, 2008, vol.2, pp.1449-1453
[10] Jelsovka, D., Slovakia ; Hudec, R., Breznan, M.: “Face recognition on FERET face database using LDA and CCA methods”, 2011 34th International Conference on Telecommunications and Signal Processing (TSP), 2011, pp.570-574
[11] Ajitha, S., Fathima, A.A., Vaidehi, V., Hemalatha, M.: “Face recognition system using Combined Gabor Wavelet and DCT approach”, 2014 International Conference on Recent Trends in Information Technology (ICRTIT), 2014, pp.1-6
[12] Xiao-ming Wang, Chang Huang, Guo-yu Ni, Jin-gao Liu: “Face Recognition Based on Face Gabor Image and SVM”, 2009. CISP '09. 2nd International Congress on Image and Signal Processing, 2009, pp.1-4
[13] Ahonen, T., Hadid, A., Pietikainen, M.: “Face Description with Local Binary Patterns: Application to Face Recognition”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, vol.28, issue.12, pp.2037-2041
[14] Guoying Zhao, Pietikainen, M.: “Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, vol.29, issue.6, pp.915-928
[15] Wankou Yang, Changyin Sun: “Face recognition using improved local texture patterns”, 2011 9th World Congress on Intelligent Control and Automation (WCICA), 2011, pp.48-51
[16] Pan Hong, Xia Si-Yu, Jin Li-Zuo, Xia Liang-Zheng: “Illumination invariant face recognition based on improved Local Binary Pattern”, 2011 30th Chinese Control Conference (CCC), 2011, pp.3268-3272
[17] Breu, H., Gil, J., Kirkpatrick, D., Werman, M.: “Linear time Euclidean distance transform algorithms”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, vol.17, issue.5, pp.529-533
[18] Hafner, J., Sawhney, H.S., Equitz, W., Flickner, M.: “Efficient color histogram indexing for quadratic form distance functions”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, vol.17, issue.7, pp.729-736
[19] Barla, A., Odone, F., Verri, A.: “Histogram intersection kernel for image classification”, 2003 International Conference on Image Processing, 2003, vol.3, pp. III - 513-16 vol.2
[20] Jianfeng Ren, Xudong Jiang, Junsong Yuan: “A Chi-Squared-Transformed Subspace of LBP Histogram for Visual Recognition”, IEEE Transactions on Image Processing, 2015, vol.24, issue.6, pp.1893-1904
[21] Boutellaa, E., Bengherabi, M., Boulkenafet, Z., Harizi, F.: “Face verification using local binary patterns generic histogram adaptation and Chi-square based decision”, 2013 4th European Workshop on Visual Information Processing (EUVIP), 2013, pp.142-147
[22] Rainer Lienhart, Jochen Maydt: “An Extended Set of Haar-like Features for Rapid Object Detection”, 2002 International Conference on Image Processing, 2002, vol.1, pp. I-900 - I-903
[23] Mita, T., Kaneko, T., Hori, O.: “Joint Haar-like features for face detection”, Tenth IEEE International Conference on Computer Vision, 2005, vol.2, pp.17-21
[24] Viola, P., Jones, M.: “Robust Real-Time Face Detection”, International Journal of Computer Vision, 2004, 57(2), pp.137-154
[25] Viola, P., Jones, M.: “Rapid object detection using a boosted cascade of simple features”, 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001, vol. 1, pp. I-511 - I-518
[26] Chunhua Shen, Paisitkriangkrai, S., Zhang, Jian: “Efficiently Learning a Detection Cascade With Sparse Eigenvectors”, IEEE Transactions on Image Processing, 2010, vol.20, issue.1, pp.22-35
[27] Ning Jiang, Wenxin Yu, Shaopeng Tang, Goto, S.: “A cascade detector for rapid face detection”, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications (CSPA), 2011, pp. 155-158
[28] Rong Xiao, Huaiyi Zhu, He Sun, Xiaoou Tang: “Dynamic Cascades for Face Detection”, 2007. IEEE 11th International Conference on Computer Vision, 2007, pp. 1-8
[29] Wikipedia: https://en.wikipedia.org/wiki/Bilinear_interpolation
[30] Wikipedia: https://en.wikipedia.org/wiki/Median_filter
[31] Lee, P.-H., Wu, S.-W., Yi-Ping Hung: “Illumination Compensation Using Oriented Local Histogram Equalization and its Application to Face Recognition”, IEEE Transactions on Image Processing, 2012, vol.21, issue.9, pp.4280-4289
[32] Sharif, M., Mohsin, S., Jamal, M.J., Raza, M.: “Illumination normalization preprocessing for face recognition”, 2010 International Conference on Environmental Science and Information Application Technology (ESIAT), 2010, vol.2, pp.44-47
[33] Ghinea, G., Kannan, R., Kannaiyan, S.: ” Gradient-Orientation-Based PCA Subspace for Novel Face Recognition”, IEEE Access, 2014, vol.2, pp.914-920
[34] Hu, H., Zhang, P. and de la Torre, F.: “Face recognition using enhanced linear discriminant analysis”, IET Computer Vision, 2010, vol.4, issue.3, pp.195-208
[35] Zhenhua Chai, Zhenan Sun, Mendez-Vazquez, H., Ran He and Tieniu Tan: “Gabor Ordinal Measures for Face Recognition”, IEEE Transactions on Information Forensics and Security, 2013, vol.9, issue.1, pp.14-26
[36] Di Huang, Caifeng Shan, Ardabilian, M. and Yunhong Wang: “Local Binary Patterns and Its Application to Facial Image Analysis: A Survey”, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 2011, vol.41, issue.6, pp.765-781
[37] Chi-Kien Tran, Tsair-Fwu Lee, Liyun Chang and Pei-Ju Chao: ” Face Description with Local Binary Patterns and Local Ternary Patterns: Improving Face Recognition Performance Using Similarity Feature-Based Selection and Classification Algorithm”, 2014 International Symposium on Computer, Consumer and Control (IS3C), 2014, pp.520-524
[38] Jabid, T., Kabir, M.H. and Chae, O.: “Local Directional Pattern (LDP) for face recognition”, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), 2010, pp.329-330
[39] Jabid, T., Kabir, M.H. and Oksam Chae: “Facial expression recognition using Local Directional Pattern (LDP)”, 2010 17th IEEE International Conference on Image Processing (ICIP), 2010, pp.1605-1608
[40] Ramirez Rivera, A., Rojas Castillo and Oksam Chae: “Local Directional Number Pattern for Face Analysis: Face and Expression Recognition”, IEEE Transactions on Image Processing, 2013, vol.22, issue.5, pp.1740-1752
[41] Arivazhagan, S., Priyadharshini, R.A. and Sowmiya, S.: “Face recognition based on local directional number pattern and ANFIS classifier”, 2014 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT), 2014, pp.1627-1631
[42] Faraji, M.R. and Xiaojun Qi: “Face recognition under illumination variations based on eight local directional patterns”, IET Biometrics, 2015, vol.4, issue.1, pp.10-17
[43] Taskeed Jabid, Md. Hasanul Kabir, and Oksam Chae: “Robust Facial Expression Recognition Based on Local Directional Pattern”, ETRI Journal, 2010, vol.32, num.5, pp.784-794
[44] Caifeng Shan, Shaogang Gong and McOwan, Peter W.: “Robust facial expression recognition using local binary patterns”, 2005. ICIP 2005. IEEE International Conference on Image Processing, 2005, vol.2, pp. II - 370-3
[45] Edward Rosten and Tom Drummond: “Fusing points and lines for high performance tracking”, 2005. ICCV 2005. Tenth IEEE International Conference on Computer Vision, 2005, vol.2, pp.1508-1515
[46] Edward Rosten and Drummond: “Machine learning for high-speed corner detection”, ECCV'06 Proceedings of the 9th European conference on Computer Vision, 2006, vol.1, pp.430-443
[47] Computer-Vision-Talks: “Comparison of the OpenCV’s feature detection algorithms”, 2014, http://computer-vision-talks.com/articles/2011-01-04-comparison-of-the-opencv-feature-detection-algorithms/
[48] Tinne Tuytelaars and Krystian Mikolajczyk: “Local Invariant Feature Detectors: A Survey”, Foundations and Trends® in Computer Graphics and Vision, 2008, vol.3, issue.3, pp.177-280
[49] Android Developers: “Host-based Card Emulation”, https://developer.android.com/guide/topics/connectivity/nfc/hce.html
[50] Alattar, M. and Achemlal, M.: “Host-Based Card Emulation: Development, Security, and Ecosystem Impact Analysis”, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS), 2014, pp.506-509
[51] Munch-Ellingsen, A., Karlsen, R., Andersen, A. and Akselsen, S.: “Two-factor authentication for android host card emulated contactless cards”, 2015 First Conference on Mobile and Secure Services (MOBISECSERV), 2015, pp.1-6
[52] Michael Roland: “Software Card Emulation in NFC-enabled Mobile Phones: Great Advantage or Security Nightmare?”, Fourth International Workshop on Security and Privacy in Spontaneous Interaction and Mobile Phone Use (IWSSI/SPMU), 2012
[53] Adrian Stabiszewski: “Android Host-based Card Emulation connected to ACR122U”, http://blog.opendatalab.de/hack/2013/11/07/android-host-card-emulation-with-acr122/
[54] FERET Database: http://www.itl.nist.gov/iad/humanid/feret/
http://www.nist.gov/itl/iad/ig/colorferet.cfm
[55] Yale Database: http://vision.ucsd.edu/content/yale-face-database
[56] Faces94 Database: http://cswww.essex.ac.uk/mv/allfaces/faces94.html
[57] D'Cunha, N.W., Birajdhar, S.A., Manikantan, K. and Ramachandran, S.: “Face recognition using Homomorphic Filtering as a pre-processing technique”, 2013 International Conference on Emerging Trends in Communication, Control, Signal Processing & Computing Applications (C2SPCA), 2013, pp.1-6
[58] Kishore, B., Rana, V.L., Manikantan, K. and Ramachandran, S.: “Face recognition using Gabor-Feature-based DFT shifting”, 2014 9th International Conference on Industrial and Information Systems (ICIIS), 2014, pp.1-8
[59] Babu, S.H., Shreyas, H.R., Manikantan, K. and Ramachandran, S.: “Face Recognition Using Active Illumination Equalization and Mirror Image Superposition as Pre-processing Techniques”, 2014 Fifth International Conference on Signal and Image Processing (ICSIP), 2014, pp.96-101
[60] Erhu Zhang, Yongchao Li and Faming Zhang: “A single training sample face recognition algorithm based on sample extension”, 2013 Sixth International Conference on Advanced Computational Intelligence (ICACI), 2013, pp.324-327
[61] Ghinea, G., Kannan, R. and Kannaiyan, S. : “Gradient-Orientation-Based PCA Subspace for Novel Face Recognition”, IEEE Access, 2014, vol.2, pp.914-920
[62] Suruliandi, A., Meena, K. and Reena Rose, R.: “Local binary pattern and its derivatives for face recognition”, IET Computer Vision, 2012, vol.6, issue.5, pp.480-488