簡易檢索 / 詳目顯示

研究生: 劉家羽
Jia-Yu Liu
論文名稱: 基於多目標深度學習規則生成的社群媒體自動圖像建議系統
An intelligent image recommendation system for social media by dual-objective deep learning-based rule generation
指導教授: 王孔政
Kung-Jeng Wang
口試委員: 陳子立
何秀青
王孔政
學位類別: 碩士
Master
系所名稱: 產學創新學院 - 智慧製造科技研究所
Graduate Institute of Intelligent Manufacturing Tech
論文出版年: 2023
畢業學年度: 112
語文別: 英文
論文頁數: 47
中文關鍵詞: 自動化圖像生成深度學習圖像處理雙目標模型社群媒體平台
外文關鍵詞: automatic image generation, deep learning, image processing, dual-objective model, social media platforms
相關次數: 點閱:71下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 如何才能夠吸引觀眾的目光,進而引起共鳴,成為社群媒體經營者所關心的議題。雖然圖像生成正在興起,但是指引圖像生成的適當規則變得相當具有挑戰性。本研究開發了一套智慧圖像建議系統(IIRS),透過基於雙目標深度學習的規則生成機制提取Instagram上的圖像特徵,以滿足高互動率與健康的願望。本研究以早午餐服務業做為案例進行研究,將圖像分為五組吸引力等級和三組營養等級。透過分析和預測圖像的吸引力特徵和熱量程度,然後生成相關的圖像生成/修改規則,以建議進一步的自動圖像生成。研究結果顯示,對於吸引力和營養的預測準確率分別達到47%和72.68%,而所提出的圖像建議系統有助於為社群媒體平台提供明確而具成效的建議。


    How to attract the attention of the audience and then resonate has become a concern for social media managers. Although image generation is emerging, appropriate rules to guide image generation becomes challenging. This study developed an intelligent image recommendation system (IIRS). By extracting the image features on Instagram by a dual-objective deep learning-based rule generation mechanism, the high engagement rate and diet desires are fulfilled. A case study on Brunch service industry is conducted. The images are categorized into five levels of attractiveness and three levels of nutrition. The attractiveness features and the calories level of images are analyzed and predicted, and then relevant image generation/modification rules are generated to advise further automatic image generation. The results showed that the accuracies of attractiveness and nutrition reached 47% and 72.68% respectively. The proposed image advice system facilitates definite and productive advices for social media platforms.

    摘要 I Abstract II 誌謝 III Table of content IV List of Figures VI List of Tables VII 1. Introduction 1 2. Literature review 4 2.1 Marketing by social media influencer 4 2.2 Dual-objective optimization for image design 5 2.3 Tools for image generation 5 3. Method 6 3.1 Proposed framework 6 3.2 Feature extraction and reduction 6 3.2.1 Features by image signal processing 7 3.2.2 Features by panoptic segmentation 8 3.2.3 Features by customized instance segmentation 10 3.2.4 Composition features of image 10 3.2.5 Feature reduction 12 3.3 Dual-objective image design 13 3.3.1 Image appeal 14 3.3.2 Nutrition percept 15 3.4 Image rule generation for brunch industry 17 4. Experiment 21 4.1 Comparison of prediction accuracy of image engagement rate by ID3 and Cubist models 21 4.2 Experiment result 22 5. Conclusion 30 References 32 Appendix 1. The data collection module by web crawler 35 Appendix 2. Definition of OSF features 36 Appendix 3. Results of the performance evaluation of the customized instance segmentation model for brunch food 38 Appendix 4. Major Image generation tools 40 Appendix 5. Advice rules regarding the selected features 44

    References
    Adams, L. C., Busch, F., Truhn, D., Makowski, M. R., Aerts, H. J., & Bressem, K. K. (2023). What does DALL-E 2 know about radiology?. Journal of Medical Internet Research, 25, e43110.
    Arora, A., Bansal, S., Kandpal, C., Aswani, R., & Dwivedi, Y. (2019). Measuring social media influencer index-insights from Facebook, Twitter and Instagram. Journal of Retailing and Consumer Services, 49, 86-101.
    Auxier, B., & Anderson, M. (2021). Social media use in 2021. Pew Research Center, 1, 1-4.
    Bharti, K. K., & Singh, P. K. (2015). Hybrid dimension reduction by integrating feature selection with feature extraction method for text clustering. Expert Systems with Applications, 42(6), 3105-3114.
    Borji, A. (2022). Generated faces in the wild: Quantitative comparison of stable diffusion, midjourney and dall-e 2. arXiv preprint arXiv:2210.00586.
    Caesar, H., Uijlings, J., & Ferrari, V. (2018). Coco-stuff: Thing and stuff classes in context. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1209-1218).
    Chang, R. C. (2022). Developing a taxonomy of motivations for foodstagramming through photo elicitation. International Journal of Hospitality Management, 107, 103347.
    Chiang, B. M. (2022). Researched on the Influence of the Color of the Restaurant in the Homestay on Consumer Perception (Doctoral dissertation, National Chi Nan University, Taiwan).
    Chiu, T. K. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney. Interactive Learning Environments, 1-17.
    Coates, A. E., Hardman, C. A., Halford, J. C., Christiansen, P., & Boyland, E. J. (2019). Social media influencer marketing and children’s food intake: a randomized trial. Pediatrics, 143(4).
    Costa, V. G., & Pedreira, C. E. (2023). Recent advances in decision trees: An updated survey. Artificial Intelligence Review, 56(5), 4765-4800.
    Detectron2 (2023) https://github.com/facebookresearch/detectron2
    Filieri, R., Yen, D. A., & Yu, Q. (2021). # ILoveLondon: An exploration of the declaration of love towards a destination on Instagram. Tourism Management, 85, 104291.
    Gambetti, A., & Han, Q. (2022). Camera eats first: exploring food aesthetics portrayed on social media using deep learning. International Journal of Contemporary Hospitality Management, 34(9), 3300-3331.
    Gunantara, N. (2018). A review of multi-objective optimization: Methods and its applications. Cogent Engineering, 5(1), 1502242.
    Hallez, L., Vansteenbeeck, H., Boen, F., & Smits, T. (2023). Persuasive packaging? The impact of packaging color and claims on young consumers’ perceptions of product healthiness, sustainability and tastiness. Appetite, 182, 106433.
    He, X. F., & Lv, X. G. (2022). From the color composition to the color psychology: Soft drink packaging in warm colors, and spirits packaging in dark colors. Color Research & Application, 47(3), 758-770.
    Hollebeek, L. D., Glynn, M. S., & Brodie, R. J. (2014). Consumer brand engagement in social media: Conceptualization, scale development and validation. Journal of Interactive Marketing, 28(2), 149-165.
    Holmberg, C., Chaplin, J. E., Hillman, T., & Berg, C. (2016). Adolescents' presentation of food in social media: An explorative study. Appetite, 99, 121-129.
    Kay, S., Mulcahy, R., & Parkinson, J. (2020). When less is more: the impact of macro and micro social media influencers’ disclosure. Journal of Marketing Management, 36(3-4), 248-278.
    Lim, X. J., Radzol, A. M., Cheah, J., & Wong, M. W. (2017). The impact of social media influencers on purchase intention and the mediation effect of customer attitude. Asian Journal of Business Research, 7(2), 19-36.
    Lin, T. Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., ... & Dollár, P. (2014). Microsoft COCO: Common Objects in Context. arXiv preprint arXiv:1405.0312.
    Marcus, G., Davis, E., & Aaronson, S. (2022). A very preliminary analysis of DALL-E 2. arXiv preprint arXiv:2204.13807.
    Masuda, H., Han, S. H., & Lee, J. (2022). Impacts of influencer attributes on purchase intentions in social media influencer marketing: Mediating roles of characterizations. Technological Forecasting and Social Change, 174, 121246.
    Matz, S. C., Segalin, C., Stillwell, D., Müller, S. R., & Bos, M. W. (2019). Predicting the personal appeal of marketing images using computational methods. Journal of Consumer Psychology, 29(3), 370-390.
    McDonnell, E. M. (2016). Food porn: The conspicuous consumption of food in the age of digital reproduction. In Food, media and contemporary culture: The edible image (pp. 239-265). London: Palgrave Macmillan UK.
    Min, W., Wang, Z., Liu, Y., Luo, M., Kang, L., Wei, X., ... & Jiang, S. (2023). Large scale visual food recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, in press.
    Mou, J. B. (2020). Study on social media marketing campaign strategy--TikTok and Instagram (Doctoral dissertation, Massachusetts Institute of Technology, U.S.).
    Nouri, M. (2018). The power of influence: traditional celebrity vs social media influencer. Pop Culture Intersections. 32.
    Pilgrim, K., & Bohnet-Joschko, S. (2019). Selling health and happiness how influencers communicate on Instagram about dieting and exercise: Mixed methods research. BMC Public Health, 19(1), 1-9.
    Priyanka, & Kumar, D. (2020). Decision tree classifier: a detailed survey. International Journal of Information and Decision Sciences, 12(3), 246-269.
    Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems. 3, 121-154.
    Rodriguez, S. (2023). Marketing: Color Psychology in Branding (Undergraduate project, California State University, U.S.).
    R101-FPN (2024) https://github.com/facebookresearch/detectron2/blob/main/MODEL_ZOO.md
    Salkowitz, R. (2022). Midjourney founder David Holz on the impact of AI on art, imagination and the creative economy. Forbes. Sengupta, S., & Vaish, A. (2023). A study on social media and higher education during the COVID-19 pandemic. Universal Access in the Information Society, 1-23.
    Spence, C. (2024). On the psychological effects of food color. In Handbook on natural pigments in food and beverages (pp. 33-60). Woodhead Publishing.
    United States Department of Agriculture (2024) https://www.usda.gov/
    World Health Organization (2024) https://www.who.int/
    Zhang, C., Wang, W., Pangaro, P., Martelaro, N., & Byrne, D. (2023, June). Generative Image AI using design sketches as input: Opportunities and challenges. In Proceedings of the 15th Conference on Creativity and Cognition (pp. 254-261).
    Zhang, J., Li, M., Liu, W., Lauria, S., & Liu, X. (2022). Many-objective optimization meets recommendation systems: A food recommendation scenario. Neurocomputing, 503, 109-117.

    無法下載圖示
    全文公開日期 2030/01/29 (校外網路)
    全文公開日期 2030/01/29 (國家圖書館:臺灣博碩士論文系統)
    QR CODE