1. School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300073, China; 2. School of Traditional Chinese Medicine Engineering, Tianjin University of Traditional Chinese Medicine, Tianjin 300073, China
Research on Tongue Image Collection and Analysis Based on Smartphone
1. School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300073, China; 2. School of Traditional Chinese Medicine Engineering, Tianjin University of Traditional Chinese Medicine, Tianjin 300073, China
摘要Tongue diagnosis is a diagnostic method to understand the physiological functions and pathological changes of the human body by observing human tongue quality, tongue coating, and sublingual collateral veins. Tongue elephant research is an important part of objective Chinese medicine. Based on the research of tongue image analysis method, the design of a tongue image collection analysis system based on the smartphone platform was demonstrated. This research uses a smartphone camera to collect tongue images, upload them to the server and complete tongue image analysis on the server. Finally, the tongue image analysis results are generated, and the results are transmitted from the server to the smartphone mobile terminal. We used HTTP protocol for communication between mobile client and server. We asked professional TCM doctors to evaluate the results of tongue analysis in 100 cases, and the final anastomosis rate was above 80%. This study fills in the gaps in the mobile platform of objectification of tongue diagnosis, which is conducive to the use of mobile phones to collect tongue images anytime, anywhere, and to conveniently share the results of tongue diagnosis with physicians. With an Internet connection, users can use their smartphones to remotely diagnose their tongues, who can store and generate their own personal diagnostic reports.
Abstract：Tongue diagnosis is a diagnostic method to understand the physiological functions and pathological changes of the human body by observing human tongue quality, tongue coating, and sublingual collateral veins. Tongue elephant research is an important part of objective Chinese medicine. Based on the research of tongue image analysis method, the design of a tongue image collection analysis system based on the smartphone platform was demonstrated. This research uses a smartphone camera to collect tongue images, upload them to the server and complete tongue image analysis on the server. Finally, the tongue image analysis results are generated, and the results are transmitted from the server to the smartphone mobile terminal. We used HTTP protocol for communication between mobile client and server. We asked professional TCM doctors to evaluate the results of tongue analysis in 100 cases, and the final anastomosis rate was above 80%. This study fills in the gaps in the mobile platform of objectification of tongue diagnosis, which is conducive to the use of mobile phones to collect tongue images anytime, anywhere, and to conveniently share the results of tongue diagnosis with physicians. With an Internet connection, users can use their smartphones to remotely diagnose their tongues, who can store and generate their own personal diagnostic reports.
通讯作者:
Xuemin Wang, School of precision instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300073, China. E-mail address: xueminw@tju.edu.cn
引用本文:
Xuemin Wang, Yingying Sun, Qiuyue Wang, Zhifeng Yu. Research on Tongue Image Collection and Analysis Based on Smartphone[J]. 中国生物医学工程学报(英文版）, 2020, 29(2): 1-9.
Xuemin Wang, Yingying Sun, Qiuyue Wang, Zhifeng Yu. Research on Tongue Image Collection and Analysis Based on Smartphone. Chinese Journal of Biomedical Engineering, 2020, 29(2): 1-9.
[1] Guo Lei, Wang Yongyan, Zhang Zhibin, et al.Origination and development of syndrome concept in traditional Chinese medicine[J]. Journal of Chinese Integrative Medicine,2006,4:335-338. [2] Wang Qi. The present situation and thinking of the objectification research of the four diagnosis of traditional Chinese Medicine [J]. Journal of Traditional Chinese Medicine,2000,4:242-245. [3] Liu Bin, Hu Guangqin, Zhang Xinfeng,et al.An improved automatic description method of tongue coating thickness in Chinese medicine [J]. Beijing Biomedical Engineering,2018,37(2):157-163. [4] Cui Zhenchao. Tongue body segmentation and texture classification in computerized tongue diagnosis[D]. Harbin Institute of Technology,2015. [5] Lu Yunxi. Deep learning based TCM tongue image color correction, segmentation and server system [D]. Beijing University of Technology,2019. [6] Lu Yunxi, Li Xiaoguang, Zhang Hui,et al.Review on tongue image segmentation for traditional Chinese medicine: methodologies, performances and prospects[J]. Acta Automatica Sinica:1-12. [7] Su Mingyu. Study on the Extraction and Classification of Tongue Features in the Tongue Diagnosis of Traditional Chinese Medicine[D]. Changchun University of Technology,2018. [8] Xie Jiacheng. Application and practice of deep learning in classification of tongue image in traditional Chinese medicine [D]. Jilin University,2019. [9] Huang Shuqiong, Zhang Yunlong, Zhou Jing,et al.Research progress on the objectification, quantitation and standardization of tongue manifestation in traditional Chinese medicine [J].China Journal of Traditional Chinese Medicine and Pharmacy, 2017(4):1625-1627. [10] Ye Jianhong. Objective research ideas of tongue diagnosis in traditional Chinese Medicine [J]. Journal of Southwest Medical University,2001,4:292-293. [11] Liu Ming, Xie Yuemin, Zhao Jing,et al.Study on the Uniformity in Tongue Exposure Collected by TCM Tongue Collector [J]. Western Journal of Traditional Chinese Medicine,2019,32(11):131-133. [12] Hu Mingchun, Cheng Minghsun, Lan Kunchan. Color Correction Parameter Estimation on the Smartphone and Its Application to Automatic Tongue Diagnosis[J]. Journal of Medical Systems,2016,40(1): 1-8. [13] Marzia Hoque Tania, Khin Lwin, Mohammed Alamgir Hossain. Advances in automated tongue diagnosis techniques[J]. Elsevier B.V,2019,8(1):42-56. [14] Li Danxi, Guan Jing, Li Feng. Development of Tongue Instrument and Progress of Its Application in Traditional Chinese Medicine Tongue Characterization Research [J]. World Chinese Medicine,2017,12(2):456-460. [15] Yuan Shanmin,Qian Peng,Li Fufeng.Research progress on color correction method of tongue and face diagnosis in TCM [J]. China Journal of Traditional Chinese Medicine and Pharmacy,2019,34(9):4183-4185. [16] Jin Hai,Yu Lihua. Influence of Color Temperature and Color Rendering of Lamp on Interior Light Environment [J]. China Illuminating Engineering Journal,2000,3:27-29. [17] Xu Xiaozhao, Cai Yihang, Liu Changjing,et al.Color Cast Detection and Color Correction Methods Based on Image Analysis [J]. Measurement & Control Technology,2008(5):10-12,21. [18] Xiao X, Ma L. Color transfer in correlated color space[C]. Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications. ACM, 2006:305-309. [19] Pang Qing. Research on key technology of color measurement in visual inspection system [D]. Beijing Jiaotong University, 2017. [20] 3nh.CIE Lab[EB/OL].[2014-09-15].http://www.3nh.com/news/37.html. [21] Liu Qi, Huang Xiaoyang, Wang Fuliang,et al. A method for color cast detection and color correction of tongue inspection images under natural [J]. Journal of Xiamen University(Natural Science),2016,55(2):278-284. [22] Xu Mingdong, Ma Xiaocong, Wen Zongliang,et al. Application of support vector machine in the diagnosis of hypertension in TCM syndrome [J]. China Journal of Traditional Chinese Medicine and Pharmacy,2017,2(6):2497-2500. [23] Wang Xingzheng, Zhang David. A comparative study of color correction algorithms for tongue image inspection[a]. 2nd international conference on medical biometrics[C].2010. [24] Wang Aiai. Printing color evaluation based on image color appearance model [J]. Printed in Guangdong,2019(4):24-25. [25] Kass M, Witkin A, Terzopoulos D. Snakes; active contour models[J]. International Journal of Computer Vision,1988,1(4):321-331. [26] Ding Mingquan, Wei Yuke, Ni Hao. Real-time automatic extraction of tongue contours based on GVF snake model[J]. Computer Technology and Development,2010,20(10):50-53. [27] Han Libo, Hu Guangqin, Zhang Xinfeng,et al.Separation method of tongue coating and body of tongue image based on histogram equalization and [J]. Beijing Biomedical Engineering,2019,38(1):1-6. [28] Du Song, Liu Zhaihua, Yu Zheng,et al.Textual research of the origin and development of "tongue coating" [J]. Chinese Journal of Basic Medicine in Traditional Chinese Medicine,2019,25(11):1492-1495. [29] Bian Lu. Research on data priority technology of mobile terminal communication system based on big data C/S architecture [J]. China Computer & Communication,2019,31(18):190-192. [30] Thompson M.Getting Started with GEO, CouchDB, and Node. Js[M].O'Reilly Media, Inc, 2011 Jul 29.
