近年來口腔疾病的狀況日益嚴重，全球數十億的人口有口腔健康的困擾，最普遍的疾病莫過於蛀牙及牙周病，若未就診治療將會導致牙齒脫落的問題。雖然口腔衛生習慣教育以及醫療都提升了不少，但依舊不能避免口腔疾病的發生，多數國家的人民對口腔疾病的解決方法傾向於醫療而非預防。目前最普及的預防方式就是保持良好的刷牙衛生習慣，然而每個人對於口腔的清潔確實度不一，監測分析清潔的程度實為不易，加上近年COVID-19 的影響，牙科也開始重視遠程治療。因此本研究將開發智慧口腔衛生監測系統與口腔訊息收集系統以用來收集使用者之口腔資訊，利用智能牙刷進行口腔內部圖像拍攝，預期這些口腔資訊能給臨床醫師作為遠程治療的評估。
本研究開發一種低成本的智慧牙刷監控系統，即時記錄偵測刷牙的力道、方式、路徑和時間口腔，其中刷牙位置、路徑和時間藉由陀螺儀、加速規和鄰近感測器偵測，並藉由刷牙後資料的後運算準確分析48個刷牙區域，通過人工智慧演算法偵測刷牙的力道和方式，判讀刷牙的速度和行程是正確。智慧安裝微型攝影機拍攝口腔內部照片，影像首先用於評估刷毛磨損的情況，即時提醒使用者更換牙刷或減少刷牙力道。為了捕捉更好的口內圖像，攝影機參數已經過修改和測試為更適合一般刷牙速度。透過人工智慧演算法自動篩選所需要的圖像，將同區域的口腔影像歸納整理進行影像接合，讓臨床醫師遠程評估分析更便利更有效率。

Oral diseases have affected the life of billions of people around the globe and are continuing to do so. The most common oral disorders include tooth decay and periodontal disease, which can lead to tooth loss if left untreated. Although dental health services are improved over the years, the occurrence of these diseases have not reduced. Most countries follow dentist-centric models, where less importance has given to preventive measures. COVID-19 also had an adverse effect on dental services and has increased importance of remote care service.
Oral diseases can be largely preventable if good hygiene practices are followed such as daily tooth brushing. But assessing the quality of brushing at home is difficult. This research is dedicated toward the development of a smart oral hygiene monitoring and dental information collection system which uses toothbrush as a tool to collect user intraoral data. A smart toothbrush system has been implemented to assess brushing quality and capture clear intraoral image. Oral cavity is divided into rough wider regions and fine detailed regions to detect brushing time in those regions. Brushing strokes are identified and brushing speed and force is monitored using artificial intelligent algorithms. To capture better intraoral image, camera parameters have been modified and tested. Since intraoral data will be made available to doctor remotely for possible diagnosis of oral conditions, to save their time brushing videos have been processed to generate single comprehensive image by automatic selection of important frames. Bristles wear have also been estimated using images to guide user to replace brush head when needed.

[1] R.B. Lima, A. Buarque, Oral health in the context of prevention of absenteeism and presenteeism in the workplace, Revista Brasileira de Medicina Do Trabalho. 17 (2019) 594. https://doi.org/10.5327/Z1679443520190397.
[2] FDI’s definition of oral health | FDI, (n.d.). https://www.fdiworlddental.org/fdis-definition-oral-health.
[3] FastStats - Oral and Dental Health, (n.d.). https://www.cdc.gov/nchs/fastats/dental.htm.
[4] P.B. Lockhart, M.T. Brennan, M. Thornhill, B.S. Michalowicz, J. Noll, F.K. Bahrani-Mougeot, H.C. Sasser, Poor oral hygiene as a risk factor for infective endocarditis–related bacteremia, Journal of the American Dental Association (1939). 140 (2009) 1238. /pmc/articles/PMC2770162/.
[5] L. WJ, Periodontal disease: link to cardiovascular disease., Compendium of Continuing Education in Dentistry (Jamesburg, N.J. : 1995). 21 (2000) 463–6, 468, 470 passim; quiz 484. https://europepmc.org/article/med/11199666.
[6] P. Sjögren, E. Nilsson, M. Forsell, O. Johansson, J. Hoogstraate, A Systematic Review of the Preventive Effect of Oral Hygiene on Pneumonia and Respiratory Tract Infection in Elderly People in Hospitals and Nursing Homes: Effect Estimates and Methodological Quality of Randomized Controlled Trials, Journal of the American Geriatrics Society. 56 (2008) 2124–2130. https://doi.org/10.1111/J.1532-5415.2008.01926.X.
[7] D.M. Williams, P.A. Mossey, M.R. Mathur, Leadership in global oral health, Journal of Dentistry. 87 (2019) 49–54. https://doi.org/10.1016/J.JDENT.2019.05.008.
[8] S. Kallar, I.K. Pandit, N. Srivastava, N. Gugnani, Plaque removal efficacy of powered and manual toothbrushes under supervised and unsupervised conditions: A comparative clinical study, Journal of Indian Society of Pedodontics and Preventive Dentistry. 29 (2011) 235–238. https://doi.org/10.4103/0970-4388.85832.
[9] Abrasion and Recession | Using an Evidence-based Approach to Making Patient Recommendations for Power Toothbrushes | Continuing Education Course | dentalcare.com, (n.d.). https://www.dentalcare.com/en-us/professional-education/ce-courses/ce648/abrasion-and-recession.
[10] (PDF) MODIFIED BASS TECHNIQUE, (n.d.). https://www.researchgate.net/publication/338430903_MODIFIED_BASS_TECHNIQUE.
[11] iO Series 9 Rechargeable Electric Toothbrush w/ Bluetooth | Oral-B, (n.d.). https://oralb.com/en-us/products/electric-toothbrushes/io-series-9-electric-toothbrush/.
[12] Electric Toothbrush Market Research Report: Market size, Industry outlook, Market Forecast, Demand Analysis,Market Share, Market Report 2021 - 2026, (n.d.). https://www.industryarc.com/Report/17992/electric-toothbrush-market.html.
[13] C. Ganss, N. Schlueter, S. Preiss, J. Klimek, Tooth brushing habits in uninstructed adults—frequency, technique, duration and force, Clinical Oral Investigations 2008 13:2. 13 (2008) 203–208. https://doi.org/10.1007/S00784-008-0230-8.
[14] R. Deinzer, O. Cordes, J. Weber, L. Hassebrauck, U. Weik, N. Krämer, K. Pieper, J. Margraf-Stiksrud, Toothbrushing behavior in children – an observational study of toothbrushing performance in 12 year olds, BMC Oral Health 2019 19:1. 19 (2019) 1–9. https://doi.org/10.1186/S12903-019-0755-Z.
[15] Coronavirus disease (COVID-19), (n.d.). https://www.who.int/emergencies/diseases/novel-coronavirus-2019.
[16] Oral health, (n.d.). https://doi.org/10.1016/S0140-6736(18)32279-7.
[17] M. Ghanoum, A.M. Ali, S. Elshazly, I. Alkabbany, A.A. Farag, Frame Stitching in Human Oral Cavity Environment Using Intraoral Camera, Proceedings - International Conference on Image Processing, ICIP. 2019-September (2019) 1327–1331. https://doi.org/10.1109/ICIP.2019.8803071.
[18] W. You, A. Hao, S. Li, Y. Wang, B. Xia, Deep learning-based dental plaque detection on primary teeth: a comparison with clinical assessments, BMC Oral Health 2020 20:1. 20 (2020) 1–7. https://doi.org/10.1186/S12903-020-01114-6.
[19] G. Tanriver, M.S. Tekkesin, O. Ergen, Automated Detection and Classification of Oral Lesions Using Deep Learning to Detect Oral Potentially Malignant Disorders, Cancers 2021, Vol. 13, Page 2766. 13 (2021) 2766. https://doi.org/10.3390/CANCERS13112766.
[20] T. Yoshitani, M. Ogata, K. Yatani, LumiO: A plaque-aware toothbrush, UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. (2016) 605–615. https://doi.org/10.1145/2971648.2971704.
[21] Dental Numbering Systems - Permanent Teeth, (n.d.). http://www.americantooth.com/downloads/instructions/Dental_Sys_Permanent_Teeth.pdf.
[22] P.-F. M, S.-E. JJ, B.-F. P, Comparison of modified Bass technique with normal toothbrushing practices for efficacy in supragingival plaque removal, International Journal of Dental Hygiene. 1 (2003) 110–114. https://doi.org/10.1034/J.1601-5037.2003.00018.X.
[23] C. Ganss, N. Schlueter, S. Preiss, J. Klimek, Tooth brushing habits in uninstructed adults—frequency, technique, duration and force, Clinical Oral Investigations 2008 13:2. 13 (2008) 203–208. https://doi.org/10.1007/S00784-008-0230-8.
[24] L. YJ, L. PJ, K. KS, P. W, K. KD, H. D, L. JW, Toothbrushing region detection using three-axis accelerometer and magnetic sensor, IEEE Transactions on Bio-Medical Engineering. 59 (2012) 872–881. https://doi.org/10.1109/TBME.2011.2181369.
[25] H. Huang, S. Lin, Toothbrushing Monitoring using Wrist Watch, Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. (n.d.). https://doi.org/10.1145/2994551.
[26] Z. Ouyang, J. Hu, J. Niu, Z. Qi, An asymmetrical acoustic field detection system for daily tooth brushing monitoring, 2017 IEEE Global Communications Conference, GLOBECOM 2017 - Proceedings. 2018-January (2017) 1–6. https://doi.org/10.1109/GLOCOM.2017.8255017.
[27] C.H. Chen, C.C. Wang, Y.Z. Chen, Intelligent brushing monitoring using a smart toothbrush with recurrent probabilistic neural network, Sensors (Switzerland). 21 (2021) 1–18. https://doi.org/10.3390/S21041238.
[28] M.X. Jiang, Y.M. Chen, W.H. Huang, P.H. Huang, Y.H. Tsai, Y.H. Huang, C.K. Chiang, Teeth-Brushing Recognition Based on Deep Learning, 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018. (2018). https://doi.org/10.1109/ICCE-CHINA.2018.8448684.
[29] B. Fan, Z. Ouyang, J. Niu, S. Yu, J. Rodrigues, Smart Water Flosser: A Novel Smart Oral Cleaner with IMU Sensor, 2018 IEEE Global Communications Conference, GLOBECOM 2018 - Proceedings. (2018). https://doi.org/10.1109/GLOCOM.2018.8647697.
[30] (PDF) Toothbrush abrasions and noncarious cervical lesions: evolving concepts, (n.d.). https://www.researchgate.net/publication/7468897_Toothbrush_abrasions_and_noncarious_cervical_lesions_evolving_concepts.
[31] M. Akhtaruzzaman, Force-sensitive classic toothbrush: System analysis, design, and simulation, Electrica. 21 (2021) 189–202. https://doi.org/10.5152/ELECTRICA.2021.21007.
[32] M. Hanasaki, K. Nakakura-Ohshima, T. Nakajima, Y. Nogami, H. Hayasaki, Gender difference of tooth brushing motion and force on self-brushing and caregivers’ brushing in dental professionals, Dental, Oral and Craniofacial Research. 4 (2018). https://doi.org/10.15761/DOCR.1000258.
[33] iO Series 9 Rechargeable Electric Toothbrush w/ Bluetooth | Oral-B, (n.d.). https://oralb.com/en-us/products/electric-toothbrushes/io-series-9-electric-toothbrush/.
[34] Sonicare 9900 Prestige Power Toothbrush with SenseIQ HX9990/13 | Philips, (n.d.). https://www.usa.philips.com/c-p/HX9990_13/sonicare-9900-prestige-power-toothbrush-with-senseiq.
[35] Dental Cone-beam Computed Tomography | FDA, (n.d.). https://www.fda.gov/radiation-emitting-products/medical-x-ray-imaging/dental-cone-beam-computed-tomography.
[36] 3Shape TRIOS 4 — Advanced Digital Dental Scanner, (n.d.). https://www.3shape.com/en/scanners/trios-4.
[37] H. Hwang, C.-W. Chou, Y.-J. Chen, C.-C. Yao, An Overview of Digital Intraoral Scanners: Past, Present and Future- From an Orthodontic Perspective, Taiwanese Journal of Orthodontics. 30 (2018) 3. https://doi.org/10.30036/TJO.201810_31(3).0003.
[38] M. Javaid, A. Haleem, Current status and applications of additive manufacturing in dentistry: A literature-based review, Journal of Oral Biology and Craniofacial Research. 9 (2019) 179–185. https://doi.org/10.1016/J.JOBCR.2019.04.004.
[39] CBCT Imaging (Cone Beam Computed Tomography) Webster TX, Oral Surgery Associates, (n.d.). https://www.osabayarea.com/patient-information/cbct-imaging-cone-beam-computed-tomography/.
[40] New 3Shape Integration to Simplify Dental Workflow, (n.d.). https://dental.formlabs.com/blog/new-formlabs-3shape-integration-to-simplify-dental-surgical-guide-workflow/.
[41] A. I, Digital dental photography. Part 2: Purposes and uses, British Dental Journal. 206 (2009) 459–464. https://doi.org/10.1038/SJ.BDJ.2009.366.
[42] I. Ahmad, Digital dental photography. Part 8: intra-oral set-ups, British Dental Journal 2009 207:4. 207 (2009) 151–157. https://doi.org/10.1038/sj.bdj.2009.715.
[43] The Intraoral Camera - Unique Dental of Framingham, (n.d.). https://uniquedentalofframingham.com/portfolio-item/the-intraoral-camera/.
[44] PROPHIX by ONVI - An Innovative Way To Brush. See For Yourself., (n.d.). https://www.getprophix.com/.
[45] 官方版 Adobe Photoshop | 相片和設計軟體, (n.d.). https://www.adobe.com/tw/products/photoshop.html?sdid=MH16SLTF&mv=search&ef_id=CjwKCAjwoP6LBhBlEiwAvCcthEqixBflMdvXeOjfS6_1OAjOqB0RlvtCUL3vHNzFF1V7-uE56wVCzBoCMGEQAvD_BwE:G:s&s_kwcid=AL!3085!3!474060735002!e!!g!!adobe%20photoshop!806244441!48609404784.
[46] Image Composite Editor - Microsoft Research, (n.d.). https://www.microsoft.com/en-us/research/product/computational-photography-applications/image-composite-editor/.
[47] AutoStitch, (n.d.). http://matthewalunbrown.com/autostitch/autostitch.html.
[48] Photo stitching software 360 degree Panorama image software - PTGui Stitching Software, (n.d.). https://www.ptgui.com/.
[49] R. Szeliski, Image Alignment and Stitching: A Tutorial, Foundations and Trends R in Computer Graphics and Vision. 2 (2006) 1–104. https://doi.org/10.1561/0600000009.
[50] D.G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision 2004 60:2. 60 (2004) 91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94.
[51] P.F. Alcantarilla, A. Bartoli, A.J. Davison, KAZE Features, Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 7577 LNCS (2012) 214–227. https://doi.org/10.1007/978-3-642-33783-3_16.
[52] E. Rublee, V. Rabaud, K. Konolige, G. Bradski, ORB: An efficient alternative to SIFT or SURF, Proceedings of the IEEE International Conference on Computer Vision. (2011) 2564–2571. https://doi.org/10.1109/ICCV.2011.6126544.
[53] H. Bay, T. Tuytelaars, L. van Gool, SURF: Speeded Up Robust Features, Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 3951 LNCS (2006) 404–417. https://doi.org/10.1007/11744023_32.
[54] F. A., B. C., Random sample consensus, Communications of the ACM. 24 (1981) 381–395. https://doi.org/10.1145/358669.358692.
[55] A.S. Abdelrahim, M.A. Abdelrahman, H. Abdelmunim, A. Farag, M. Miller, Novel Image-Based 3D Reconstruction of the Human Jaw using Shape from Shading and Feature Descriptors, (2011) 41.1-41.11. https://doi.org/10.5244/C.25.41.
[56] (PDF) Keyframe Extraction Techniques: A Review, (n.d.). https://www.researchgate.net/publication/348169269_Keyframe_Extraction_Techniques_A_Review.
[57] G. Lu, W. Ouyang, D. Xu, X. Zhang, C. Cai, Z. Gao, DVC: An End-to-end Deep Video Compression Framework, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2019-June (2018) 10998–11007. https://arxiv.org/abs/1812.00101v3 (accessed September 5, 2021).
[58] KEY FRAME EXTRACTION IN UNDERWATER CORAL REEF VIDEOS USING JACCORD SIMILARITY MEASURE - JCA, Journal of Analysis and Computation, ( An International Peer Reviewed, UGC Approved Journal), (n.d.). http://www.ijaconline.com/key-frame-extraction-underwater-coral-reef-videos-using-jaccord-similarity-measure/ (accessed September 5, 2021).
[59] Toothbrushes, (n.d.). https://www.ada.org/en/member-center/oral-health-topics/toothbrushes.
[60] V.L. MPC, V. der W. FA, S. DE, R. MAM, Toothbrush wear in relation to toothbrushing effectiveness, International Journal of Dental Hygiene. 17 (2019) 77–84. https://doi.org/10.1111/IDH.12370.
[61] H.R. Rawls, N.J. Mkwayi-Tulloch, R. Casella, R. Cosgrove, The Measurement of Toothbrush Wear, Journal of Dental Research. 68 (1989) 1781–1785. https://doi.org/10.1177/00220345890680121201.
[62] Simple and Effective Magnetometer Calibration · kriswiner/MPU6050 Wiki · GitHub, (n.d.). https://github.com/kriswiner/MPU6050/wiki/Simple-and-Effective-Magnetometer-Calibration (accessed November 22, 2021).
[63] S.A. Ludwig, K.D. Burnham, Comparison of Euler Estimate using Extended Kalman Filter, Madgwick and Mahony on Quadcopter Flight Data, 2018 International Conference on Unmanned Aircraft Systems, ICUAS 2018. (2018) 1236–1241. https://doi.org/10.1109/ICUAS.2018.8453465.
[64] GitHub - xioTechnologies/Fusion, (n.d.). https://github.com/xioTechnologies/Fusion/.
[65] Video for Linux Two API Specification, (n.d.). https://www.linuxtv.org/downloads/legacy/video4linux/API/V4L2_API/spec-single/v4l2.html.
[66] Home - OpenCV, (n.d.). https://opencv.org/.
[67] Bilateral Filtering in Python OpenCV with cv2.bilateralFilter() - MLK - Machine Learning Knowledge, (n.d.).
[68] Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature 2015 521:7553. 521 (2015) 436–444. https://doi.org/10.1038/nature14539.
[69] S. Indolia, A.K. Goswami, S.P. Mishra, P. Asopa, Conceptual Understanding of Convolutional Neural Network- A Deep Learning Approach, Procedia Computer Science. 132 (2018) 679–688. https://doi.org/10.1016/J.PROCS.2018.05.069.
[70] D. Liu, J. Yu, Otsu method and K-means, Proceedings - 2009 9th International Conference on Hybrid Intelligent Systems, HIS 2009. 1 (2009) 344–349. https://doi.org/10.1109/HIS.2009.74.
[71] C. Rother, V. Kolmogorov, A. Blake, GrabCut - Interactive foreground extraction using iterated graph cuts, ACM SIGGRAPH 2004 Papers, SIGGRAPH 2004. (2004) 309–314. https://doi.org/10.1145/1186562.1015720.
[72] AliceVision | Photogrammetric Computer Vision Framework, (n.d.). https://alicevision.org/.
[73] Agisoft Metashape, (n.d.). https://www.agisoft.com/.
[74] R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. (2013) 580–587. https://arxiv.org/abs/1311.2524v5 (accessed October 26, 2021).
[75] R. Girshick, Fast R-CNN arXiv1504.08083v2-1, ArXiv. (2015). https://github.com/rbgirshick/ (accessed October 26, 2021).
[76] T.-Y. Lin, P. Goyal, R. Girshick, K. He, P. Dollár, Focal Loss for Dense Object Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence. 42 (2017) 318–327. https://arxiv.org/abs/1708.02002v2 (accessed October 26, 2021).
[77] J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You Only Look Once: Unified, Real-Time Object Detection, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2016-December (2015) 779–788. https://arxiv.org/abs/1506.02640v5 (accessed October 26, 2021).
[78] J. Redmon, A. Farhadi, YOLOv3: An Incremental Improvement, (2018). http://arxiv.org/abs/1804.02767 (accessed October 26, 2021).
[79] Jocher: Yolov5 - Google Scholar, (n.d.). https://scholar.google.com/scholar?hl=en&as_sdt=0,5&cluster=8736869451157877602.
[80] Computer Vision Annotation Tool (CVAT) - 2021 Overview - viso.ai, (n.d.). https://viso.ai/computer-vision/cvat-computer-vision-annotation-tool/.