簡易檢索 / 詳目顯示

研究生: 沈宗達
Zong-Da Shen
論文名稱: 基於監督式學習之社群媒體圖像分析與建議系統
A supervised learning based model for social media image analysis and advice system
指導教授: 王孔政
Kung-Jeng Wang
口試委員: 蔣明晃
Ming-Huang Chiang
羅明琇
Ming-Shiow Lo
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2023
畢業學年度: 111
語文別: 英文
論文頁數: 75
中文關鍵詞: 社群媒體圖像吸引力互動率監督式機器學習
外文關鍵詞: social media, images attractiveness, engagement rate, supervised machine learning
相關次數: 點閱:204下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

近年來因網際網路興起的社群媒體有著非常快速的成長,促使每個人有成為社群媒體影響者的機會。對於用戶們所上傳的圖像中,哪些元素能夠引起共鳴、創造吸引力是值得探討的議題,不只過往諸多的學術研究探討也是現今營銷策略轉變中行銷者最在乎的事情。然至今未能有一套完整電腦科學系統整合出圖像吸引力的關鍵因子。綜上所述,本研究旨在開發一套智慧圖像分析與建議系統。此系統基於深度學習、機器學習與圖像處理技術構建而成,透過對圖像特徵的提取,進行吸引力及主流程度的分類預測,並給予使用者相關的圖像改善建議。本研究選定Instagram作為社群媒體代表,並以運動產業做為分析案例,透過四種吸引力定義作為系統輸出。根據結果,系統的驗證準確率達63.1%。藉由實際案例的檢視,本研究所提出之智能系統可以進行客觀的預測與建議,以此幫助社群媒體用戶進行上傳前的圖像評估與改善。


Social media has grown rapidly due to the rise of the Internet, and everyone has the opportunity to become a social media influencer. It is worth discussing which elements in the images uploaded by users can resonate and create attractiveness. However, there are few platforms to advise image attractiveness. This study aims to develop a smart image analysis and advice system. This system is constructed by deep learning and image processing technology. Through the extraction of image features, the classification and prediction of attractiveness and mainstream level are performed, and relevant image improvement suggestions are given to users. This study selects Instagram as the subject of social media, taking the sports industry as the target industry. Four categories of attractiveness are defined as the output of the system. The validation accuracy of the system reaches 63.1%. The proposed system helps social media users to evaluate and improve their images.

Abstract i 摘要 ii 誌謝 iii Table of content iv List of Figures v List of Table vi Chapter1. Introduction 1 Chapter2. Literature review 4 2.1 Influence of Internet celebrities on social media 4 2.2 Image aesthetics and decisive features 4 2.3 Machine learning classifier 6 2.4 Research gap 7 Chapter3. Method 8 3.1 Research framework 8 3.2 Data collection with crawler module 9 3.3 Features extraction 10 3.3.1 OSF feature detection method 10 3.3.2 Panoptic segmentation features 11 3.3.3 Customized Instance segmentation 13 3.3.4 Image composition features 14 3.4 Image attractiveness and ranking 16 3.5 Features reduction 18 3.6 Intelligent image analysis and advice system 19 Chapter4. Experiment results and discussion 21 4.1 Experiment setup 21 4.2 Modeling decision tree classifiers for image classification 22 4.3 Sensitivity analysis 26 4.4 Rules and implications of the sports industry 28 Chapter5. Conclusion 30 References 33 Appendix 1. The crawler algorithm 39 Appendix 2. Computational procedure for negative space ratio 40 Appendix 3. Complete CART model 41 Appendix 4. Illustrations 51 Appendix 5. Reduced CART model 60

Abdullah, T., Deraman, S. N. S., Zainuddin, S. A., Azmi, N. F., Abdullah, S. S., Anuar, N. I. M., ... & Hasan, H. (2020). Impact of Social Media Influencer on Instagram User Purchase Intention towards the Fashion Products: The Perspectives of UMK Pengkalan Chepa Campus Students. European Journal of Molecular & Clinical Medicine.
Adagbasa, E. G., Adelabu, S. A., & Okello, T. W. (2022). Application of deep learning with stratified K-fold for vegetation species discrimation in a protected mountainous region using Sentinel-2 image. Geocarto International, 37(1), 142-162.
Almustafa, K. M. (2020). Prediction of heart disease and classifiers’ sensitivity analysis. BMC bioinformatics, 21(1), 1-18.
Asuero, A. G., Sayago, A., & González, A. G. (2006). The correlation coefficient: An overview. Critical reviews in analytical chemistry, 36(1), 41-59.
Bharati, M. H., Liu, J. J., & MacGregor, J. F. (2004). Image texture analysis: methods and comparisons. Chemometrics and intelligent laboratory systems, 72(1), 57-71.
Casaló, L. V., Flavián, C., & Ibáñez-Sánchez, S. (2021). Be creative, my friend! Engaging users on Instagram by promoting positive emotions. Journal of Business Research, 130, 416-425.
Celona, L., Leonardi, M., Napoletano, P., & Rozza, A. (2022). Composition and style attributes guided image aesthetic assessment. IEEE Transactions on Image Processing, 31, 5009-5024.
Charbuty, B., & Abdulazeez, A. (2021). Classification based on decision tree algorithm for machine learning. Journal of Applied Science and Technology Trends, 2(01), 20-28.
Chernov, V., Alander, J., & Bochko, V. (2015). Integer-based accurate conversion between RGB and HSV color spaces. Computers & Electrical Engineering, 46, 328-337.
Choi, T. R., & Sung, Y. (2018). Instagram versus Snapchat: Self-expression and privacy concern on social media. Telematics and informatics, 35(8), 2289-2298.
Deng, Y., Loy, C. C., & Tang, X. (2017). Image aesthetic assessment: An experimental survey. IEEE Signal Processing Magazine, 34(4), 80-106.
Detectron2 (2022) https://github.com/facebookresearch/detectron2.
Freberg, K., Graham, K., McGaughey, K., & Freberg, L. A. (2011). Who are the social media influencers? A study of public perceptions of personality. Public Relations Review, 37(1), 90-92.
Guo, Y. W., Liu, M., Gu, T. T., & Wang, W. P. (2012, September). Improving photo composition elegantly: Considering image similarity during composition optimization. In Computer graphics forum (Vol. 31, No. 7, pp. 2193-2202). Oxford, UK: Blackwell Publishing Ltd.
Hafiz, A. M., & Bhat, G. M. (2020). A survey on instance segmentation: state of the art. International Journal of Multimedia Information Retrieval, 9(3), 171-189.
Han, J., Quan, R., Zhang, D., & Nie, F. (2017). Robust object co-segmentation using background prior. IEEE Transactions on Image Processing, 27(4), 1639-1651.
Hao, S., Zhou, Y., & Guo, Y. (2020). A brief survey on semantic segmentation with deep learning. Neurocomputing, 406, 302-321.
Hollebeek, L. D., Glynn, M. S., & Brodie, R. J. (2014). Consumer brand engagement in social media: Conceptualization, scale development and validation. Journal of Interactive Marketing, 28(2), 149-165.
Islam, M. B., Lai-Kuan, W., & Chee-Onn, W. (2017). A survey of aesthetics-driven image recomposition. Multimedia Tools and Applications, 76(7), 9517-9542.
Ji, Z., Wang, J., Su, Y., Song, Z., & Xing, S. (2013). Balance between object and background: Object-enhanced features for scene image classification. Neurocomputing, 120, 15-23.
Kapoor, K. K., Tamilmani, K., Rana, N. P., Patil, P., Dwivedi, Y. K., & Nerur, S. (2018). Advances in social media research: Past, present and future. Information Systems Frontiers, 20(3), 531-558.
Kim, D., Woo, S., Lee, J. Y., & Kweon, I. S. (2022). Dense Pixel-Level Interpretation of Dynamic Scenes With Video Panoptic Segmentation. IEEE Transactions on Image Processing, 31, 5383-5395.
Kirillov, A., He, K., Girshick, R., Rother, C., & Dollár, P. (2019). Panoptic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 9404-9413).
Li, L., Zhu, H., Zhao, S., Ding, G., & Lin, W. (2020). Personality-assisted multi-task learning for generic and personalized image aesthetics assessment. IEEE Transactions on Image Processing, 29, 3898-3910.
Li, X., & Chen, D. (2022). A survey on deep learning-based panoptic segmentation. Digital Signal Processing, 120, 103283.
Lim, X. J., Radzol, A. M., Cheah, J., & Wong, M. W. (2017). The impact of social media influencers on purchase intention and the mediation effect of customer attitude. Asian Journal of Business Research, 7(2), 19-36.
Lin, T. Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., ... & Zitnick, C. L. (2014, September). Microsoft coco: Common objects in context. In European conference on computer vision (pp. 740-755). Springer, Cham.
Liu, H., Zhou, M., & Liu, Q. (2019). An embedded feature selection method for imbalanced data classification. IEEE/CAA Journal of Automatica Sinica, 6(3), 703-715.
Lo, K. Y., Liu, K. H., & Chen, C. S. (2012, November). Assessment of photo aesthetics with efficiency. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012) (pp. 2186-2189). IEEE.
Machajdik, J., & Hanbury, A. (2010, October). Affective image classification using features inspired by psychology and art theory. In Proceedings of the 18th ACM international conference on multimedia (pp. 83-92).
Mahesh, B. (2020). Machine learning algorithms-a review. International Journal of Science and Research (IJSR).[Internet], 9, 381-386.
Marjerison, R. K., Huang, Y., & Chen, R. (2020). The impact of social media influencers on purchase intention towards cosmetic products in China. Journal of Behavioral Studies in Business, -.
Masuda, H., Han, S. H., & Lee, J. (2022). Impacts of influencer attributes on purchase intentions in social media influencer marketing: Mediating roles of characterizations. Technological Forecasting and Social Change, 174, 121246.
Matz, S. C., Segalin, C., Stillwell, D., Müller, S. R., & Bos, M. W. (2019). Predicting the personal appeal of marketing images using computational methods. Journal of Consumer Psychology, 29(3), 370-390.
Matz, S. C., Segalin, C., Stillwell, D., Müller, S. R., & Bos, M. W. (2019). Predicting the personal appeal of marketing images using computational methods. Journal of Consumer Psychology, 29(3), 370-390.
Mei, K., Tan, M., Yang, Z., & Shi, S. (2022, April). Modeling of feature selection based on random forest algorithm and Pearson correlation coefficient. In Journal of Physics: Conference Series (Vol. 2219, No. 1, p. 012046). IOP Publishing.
Miao, J., & Niu, L. (2016). A survey on feature selection. Procedia Computer Science, 91, 919-926.
Microsoft COCO (2022) COCO - Common Objects in Context (cocodataset.org)
Mohanaiah, P., Sathyanarayana, P., & GuruKumar, L. (2013). Image texture feature extraction using GLCM approach. International journal of Scientific and Research Publications, 3(5), 1-5.
Ng, W. S., Kao, H. C., Yeh, C. H., Huang, Q. Y., Jhou, W. C., Chen, B. Y., ... & Ouhyoung, M. (2009). Automatic photo ranking based on esthetics rules of photography. In Proceedings of Computer Graphics Workshop (cf. p. 15, 16, 18, 24, 25, 33, 35 37, 39).
OSF (2022) Open Science Framework https://www.cos.io/products/osf
Paakki, M., Sandell, M., & Hopia, A. (2019). Visual attractiveness depends on colorfulness and color contrasts in mixed salads. Food Quality and Preference, 76, 81-90.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., ... & Duchesnay, E. (2011). Scikit-learn: Machine learning in Python. the Journal of Machine Learning Research, 12, 2825-2830.
Ramola, A., Shakya, A. K., & Van Pham, D. (2020). Study of statistical methods for texture analysis and their modern evolutions. Engineering Reports, 2(4), e12149.
Rosenholtz, R., Li, Y., & Nakano, L. (2007). Measuring visual clutter. Journal of vision, 7(2), 17-17.
Saravanan, G., Yamuna, G., & Nandhini, S. (2016, April). Real time implementation of RGB to HSV/HSI/HSL and its reverse color space models. In 2016 International Conference on Communication and Signal Processing (ICCSP) (pp. 0462-0466). IEEE.
Segalin, C. A. Perina, M. Cristani and A. Vinciarelli, "The Pictures We Like Are Our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits," in IEEE Transactions on Affective Computing, vol. 8, no. 2, pp. 268-285, 1 April-June 2017, doi: 10.1109/TAFFC.2016.2516994.
Shaik, A. B., & Srinivasan, S. (2019). A brief survey on random forest ensembles in classification model. In International Conference on Innovative Computing and Communications (pp. 253-260). Springer, Singapore.
Sheth, J. N. (2018). How social media will impact marketing media. In Social media marketing (pp. 3-18). Palgrave Macmillan, Singapore.
Singh, A., Thakur, N., & Sharma, A. (2016, March). A review of supervised machine learning algorithms. In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom) (pp. 1310-1315). IEEE.
Statista. (2019). Distribution of Instagram users worldwide as of October 2019, by age and gender.
Stsiampkouskaya, K., Joinson, A., Piwek, L., & Ahlbom, C. P. (2021). Emotional responses to likes and comments regulate posting frequency and content change behaviour on social media: An experimental study and mediation model. Computers in Human Behavior, 124, 106940.
Szczypiński, P. M., Strzelecki, M., Materka, A., & Klepaczko, A. (2009). MaZda—a software package for image texture analysis. Computer methods and programs in Biomedicine, 94(1), 66-76.
Whiting, A., & Williams, D. (2013). Why people use social media: a uses and gratifications approach. Qualitative market research: an international journal.
Wilms, L., & Oberfeld, D. (2018). Color and emotion: effects of hue, saturation, and brightness. Psychological Research, 82(5), 896-914.
Zheng, L., Zhang, J., & Wang, Q. (2009). Mean-shift-based color segmentation of images containing green vegetation. Computers and Electronics in Agriculture, 65(1), 93-98.

無法下載圖示 全文公開日期 2026/01/11 (校內網路)
全文公開日期 2033/01/11 (校外網路)
全文公開日期 2033/01/11 (國家圖書館:臺灣博碩士論文系統)
QR CODE