進階搜尋


下載電子全文  
系統識別號 U0026-1708201508551000
論文名稱(中文) 利用智慧型手機進行活動與情緒辨識應用於健康照護之研究
論文名稱(英文) A Study on Activity and Mood Recognition in Healthcare Settings Using Smartphones
校院名稱 成功大學
系所名稱(中) 資訊工程學系
系所名稱(英) Institute of Computer Science and Information Engineering
學年度 103
學期 2
出版年 104
研究生(中文) 楊珮菁
研究生(英文) Pei-Ching Yang
學號 P78971244
學位類別 博士
語文別 英文
論文頁數 64頁
口試委員 指導教授-蔣榮先
口試委員-洪敬倫
召集委員-林昭維
口試委員-徐業良
口試委員-高宏宇
口試委員-郝沛毅
口試委員-鄞宗賢
口試委員-蔡正發
口試委員-邱靜如
中文關鍵字 行動健康照護  體能活動  活動辨識  情緒辨識 
英文關鍵字 mobile healthcare  physical activity  activity recognition  mood recognition 
學科別分類
中文摘要 近年來隨著行動裝置的普及與無線通訊的成長,行動健康照護顯得重要,更是現今跨領域整合發展的首要輔助媒介。行動健康照護科技的提供與應用促使使用者透過行動裝置的輔助加以協助其了解自我並進而採取行動改善之。每日活動行為監測系統,能夠記錄個人的日常活動行為,並且透過視覺化生活記錄結果提供使用者能夠檢視自我的活動習慣與行為並與醫師分享互動;情緒辨識,能夠提供使用者檢視自我情緒壓力狀態。平台進而提供客製化建議,進而協助醫師與個案進行互動與追蹤。
本研究的目的為透過機器學習技術,設計與發展活動與情緒辨識系統並提供醫護溝通平台,自動識別並記錄體能活動與情緒相關之資訊,進而協助改善個案生理或心理健康。本研究之理論基礎與原理包括特徵萃取、特徵選擇,再利用機器學習的技術,選擇分類方法並且結合認知行為理論,以提供並符合個案需求之活動行為辨識系統。本研究特定目標,包括:1)發展日常活動辨識系統與情緒辨識系統,使用機器學習方法並萃取出顯著特徵,用以發展辨識模型,提供活動與情緒辨識;2)發展醫護溝通互動平台來增進醫師對個案的了解;3)導入日常活動與情緒辨識系統於第二型糖尿病個案與輕度憂鬱症患者;4)系統導入個案後進行資料分析與探討。
實驗評估主要使用10次交叉驗證(10-fold cross-validation) 之準確性來選擇最佳的分類方法並且進行實際個案施測。本文所提之方法架構與實現系統,在糖尿病個案施測部分,實驗組具顯著性的活動量提升。本研究之日常生活記錄/日常行為操作相關資料庫、實驗結果及研究探討,可提供行動健康照護電腦資訊處理學者具系統化的設計與發展該架構於相關研究並整合,更可將所研發之成果提供行動健康照護之相關議題應用,另一方面則將能廣泛運用於各種領域之應用中,創造研究創新之價值。
英文摘要 In the recent years, with the continuous development of wireless communication and mobile devices is becoming increasingly popular. Wireless health is very important and to assist development in multidisciplinary research. Mobile healthcare technology will be the key to change user's behavior and increase for self-management of wellness via mobile devices. The platform provides convenient tools to record subjects’ physical activity, mental health status, and deliver customized recommendation. Clinicians can observe information on how many physical activities and mental health status to make better recommendations for them.
The purpose of this study is to develop an activity pattern recognition system to assist clinicians via machine learning technology to automatically identify and record physical activity and emotional status for assisting improvement subjects' healthy. Theories in feature extraction, feature selection, machine learning technology, selection classifier and Cognitive Behavioral Therapy combination to provide physical activity services of the physical activity recognition system. Specifically, the study was aimed to: 1) develop activity and mood recognition system. Using machine learning technology to extract the features and developing the recognize model for physical activity recognition and mood recognition, 2) develop a communication platform for patients and clinicians, 3) apply the physical activity recognition system and mood recognition to type 2 diabetes patients and patients with mild depression, and 4) after the system intervention, we focus on data analysis and discussion.
For the assessment of the method, we used the precision rate of the 10-fold cross-validation to select classification and recruit subjects. Experimental results show that the proposed approaches give an encouraging improvement in its tasks. Case study also shows that the literacy aptitude test and the performance of reading comprehension were significantly improved. The outcomes are expected to provide useful information for wireless health researchers and computer scientists to develop the related assistive technology, and also contribute to useful application in the future. The outcomes are expected to provide useful information for wireless health researchers and computer scientists to develop the related assistive technology, and also contribute to useful application in the future.
論文目次 摘 要 i
ABSTRACT iii
ACKNOWLEDGEMENT v
CONTENTS vi
LIST OF TABLES ix
LIST OF FIGURES x
Chapter 1. Introduction 1
1.1 Motivation 1
1.2 Purpose and Specific Aims 3
1.3 Organization of Dissertation 3
Chapter 2. Literature Review 5
2.1 Physical Activity Measurement Methods 5
2.2 Wireless Health 6
2.3 Physical Activity Recognition 7
2.4 Emotion Recognition 8
2.5 Mobile Health Applications for Health Monitoring with Cloud Support 11
Chapter 3. Activity Behavior Database Development 13
3.1 Development of Activity Behavior Database 13
3.2 Physical Activity Data Collection 14
3.2.1 Design Considerations 15
3.2.2 Activity Definition 15
3.2.3 Activity Data Collection and Exploring 16
3.3 Smartphone Usage Patterns Collection and Emotion Tagging 18
3.3.1 Design Considerations 18
3.3.2 Emotion Definition 18
3.3.3 Emotional Data Collection and Exploring 20
Chapter 4. Activity Recognition Using Accelerometer-enabled Smartphone 21
4.1 Retrieval Daily Physical Activity 22
4.1.1 Feature Extraction 24
4.1.2 Feature Selection 25
4.2 Comparison of Classifier Methods 27
4.2.1 Data Description 28
4.2.2 The Classifiers 29
4.2.3 Comparison of classifiers 29
4.2.4 Results of activity pattern recognition 30
4.3 Summary 33
Chapter 5. Daily Emotional Recognition Using Smartphone Usage Patterns 34
5.1 Development of Retrieval Daily Emotion 34
5.2 Methods for Classifier Selection 35
5.2.1 Data Description 35
5.2.2 Classification 36
5.2.3 Comparison of classifiers 38
5.3 Summary 41
Chapter 6. Experimental Results and Discussion 42
6.1 Experiments on the Physical Activity Pattern Recognition System 42
6.1.1 Design of Experiments for the Physical Activity Recognition System 42
6.1.2 Participants 44
6.1.3 Principal Findings 45
6.1.4 Limitations 50
6.2 Experiments on the Negative Emotions Detection System 50
6.2.1 Design of Experiments for the Negative Emotions Detection System 50
6.2.2 Participants 51
6.2.3 Principal Findings 52
6.2.4 Limitations 54
Chapter 7. Conclusions and Future Study 58
REFERENCES 60
參考文獻 Andersen, L. B., Harro, M., Sardinha, L. B., et al., "Physical activity and clustered cardiovascular risk in children: a cross-sectional study (The European Youth Heart Study)," The Lancet, 368: 299-304,
Burns, M. N., Begale, M., Duffecy, J., et al., "Harnessing context sensing to develop a mobile intervention for depression," Journal of medical Internet research, 13: 2011.
Bussmann, H. B., Reuvekamp, P. J., Veltink, P. H., et al., "Validity and reliability of measurements obtained with an “activity monitor” in people with and without a transtibial amputation," Physical therapy, 78: 989-998, 1998.
Callahan, D., "The WHO definition of'health'," Hastings Center Studies, 77-87, 1973.
Caspersen, C. J., Powell, K. E. and Christenson, G. M., "Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research," Public Health Reports, 100: 126-131, 1985.
Chang , C. C. Master. Taiwan: National Cheng Kung University; 2014. An Early Negative Emotion Detection System Based on Smartphone Usage Patterns.
Church, K., Hoggan, E. and Oliver, N., "A study of mobile mood awareness and communication through MobiMood," In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, ACM, 128-137, 2010.
Craig, C. L., Marshall, A. L., Sjostrom, M., et al., "International physical activity questionnaire: 12-country reliability and validity," Med Sci Sports Exerc, 35: 1381-1395, 2003.
Csikszentmihalyi, M. and Larson, R., "Validity and reliability of the experience-sampling method," The Journal of nervous and mental disease, 175: 526-536, 1987.
De Choudhury, M., Counts, S. and Horvitz, E., "Predicting postpartum changes in emotion and behavior via social media," In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 3267-3276, 2013.
Do, T.-M.-T. and Gatica-Perez, D., "By their apps you shall understand them: mining large-scale patterns of mobile phone usage," In: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, ACM, 27, 2010.
Do, T. M. T., Blom, J. and Gatica-Perez, D., "Smartphone usage in the wild: a large-scale analysis of applications and context," In: Proceedings of the 13th international conference on multimodal interfaces, ACM, 353-360, 2011.
Dolan, R. J., "Emotion, cognition, and behavior," Science, 298: 1191-1194, 2002.
Drake, G., Csipke, E. and Wykes, T., "Assessing your mood online: acceptability and use of Moodscope," Psychological medicine, 43: 1455-1464, 2013.
Faurholt-Jepsen, M., Frost, M., Vinberg, M., et al., "Smartphone data as objective measures of bipolar disorder symptoms," Psychiatry Res, 217: 124-127, 2014.
Ford, E. S., Giles, W. H. and Mokdad, A. H., "Increasing prevalence of the metabolic syndrome among US adults," Diabetes care, 27: 2444-2449, 2004.
Fujiki, Y., "iPhone as a physical activity measurement platform," In: CHI '10 Extended Abstracts on Human Factors in Computing Systems, Atlanta, Georgia, USA: ACM, 4315-4320, 2010.
Gil, G. B., Berlanga, A. and Molina, J. M., "EmotionContext: user emotion dataset using smartphones," In: Ambient Assisted Living and Home Care, Springer, 371-374, 2012.
Goleman, D., "Emotional Intelligence. Why It Can Matter More than IQ," Learning, 24: 49-50, 1996.
Gravenhorst, F., Muaremi, A., Bardram, J., et al., "Mobile phones as medical devices in mental disorder treatment: an overview," Personal and Ubiquitous Computing, 1-19, 2014.
Greco, A., Valenza, G., Lanata, A., et al., "Electrodermal Activity in Bipolar Patients during Affective Elicitation," IEEE Journal of Biomedical and Health Informatics, 18: 1865-1873, 2014.
Grunerbl, A., Muaremi, A., Osmani, V., et al., "Smartphone-Based Recognition of States and State Changes in Bipolar Disorder Patients," IEEE Journal of Biomedical and Health Informatics, 19: 140-148, 2015.
Herdem, K. C., "Reactions: Twitter based mobile application for awareness of friends' emotions," In: International Conference on Ubiquitous Computing (Ubicomp 2012), Pittsburgh, PA, USA: ACM, 796-797, 2012.
Heyward, V. H., "Advanced fitness assessment and exercise prescription," Human kinetics Champaign, IL, 2006.
Huang, S. H., LePendu, P., Iyer, S. V., et al., "Toward personalizing treatment for depression: predicting diagnosis and severity," Journal of the American Medical Informatics Association, amiajnl-2014-002733, 2014.
Insider., B., "How Much Time Do We Really Spend On Our Smartphones Every Day?," In: 2013.
Karantonis, D. M., Narayanan, M. R., Mathie, M., et al., "Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring," IEEE Transactions on Information Technology in Biomedicine, 10: 156-167, 2006.
Kemp, A. H., Quintana, D. S., Gray, M. A., et al., "Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis," Biological psychiatry, 67: 1067-1074, 2010.
Kim, H.-J. and Choi, Y. S., "Exploring emotional preference for smartphone applications," In: IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, Nevada: IEEE, 245-249, 2012.
Kim, M., Kim, H.-J., Lee, S.-J., et al., "A touch based affective user interface for smartphone," In: IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, Nevada: IEEE, 606-607, 2013.
Klasnja, P. and Pratt, W., "Healthcare in the pocket: Mapping the space of mobile-phone health interventions," Journal of Biomedical Informatics, 45: 184-198, 2012.
LaPorte, R. E., Montoye, H. J. and Caspersen, C. J., "Assessment of physical activity in epidemiologic research: problems and prospects," Public Health Reports, 100: 131-146, 1985.
LiKamWa, R., Liu, Y., Lane, N. D., et al., "Can your smartphone infer your mood?," In: PhoneSense workshop, 2011.
LiKamWa, R., Liu, Y., Lane, N. D., et al., "Moodscope: building a mood sensor from smartphone usage patterns," In: International Conference on Mobile Systems, Applications, and Services, Taipei, Taiwan: ACM, 389-402, 2013.
Luo, Z. C. Master. Taiwan: National Cheng Kung University; 2010. The Development of Activity Recognition System Using the Smartphone with Accelerometer.
MacQueen, J., "Some methods for classification and analysis of multivariate observations," In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA., 281-297, 1967.
Mark Sinyor, M., Schaffer, A. and Levitt, A., "The sequenced treatment alternatives to relieve depression (STAR* D) trial: a review," Canadian Journal of Psychiatry, 55: 126-135, 2010.
Mendis, S., "Global status report on noncommunicable diseases 2014," In: Switzerland: World Health Organization, 2014.
Naya, F., Ohmura, R., Takayanagi, F., et al., "Workers' Routine Activity Recognition using Body Movements and Location Information," In: IEEE International Symposium on Wearable Computers (ISWC), Montreux, Switzerland: 105-108, 2006.
Ness, A. R., Leary, S. D., Mattocks, C., et al., "Objectively Measured Physical Activity and Fat Mass in a Large Cohort of Children," PLoS Med, 4: e97, 2007.
Neuhäuser, M., "Wilcoxon–Mann–Whitney Test," In: Lovric, M., editor International Encyclopedia of Statistical Science, Springer Berlin Heidelberg, 1656-1658, 2014.
Okuboyejo, S. and Eyesan, O., "mHealth: Using mobile technology to support healthcare," Online journal of public health informatics, 5: 233, 2014.
Olfson, M., Marcus, S. C., Druss, B., et al., "National trends in the use of outpatient psychotherapy," American Journal of Psychiatry, 159: 1914-1920, 2002.
Pan, A., Lucas, M., Sun, Q., et al., "BIdirectional association between depression and type 2 diabetes mellitus in women," Archives of Internal Medicine, 170: 1884-1891, 2010.
Piette, J. D., Richardson, C., Himle, J., et al., "A Randomized Trial of Telephonic Counseling Plus Walking for Depressed Diabetes Patients," Medical Care, 49: 641-648, 2011.
Prince, S. A., Adamo, K. B., Hamel, M. E., et al., "A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review," The International Journal of Behavioral Nutrition and Physical Activity, 5: 56-56, 2008.
Raatikainen, K., Christensen, H. B. and Nakajima, T., "Application requirements for middleware for mobile and pervasive systems," ACM SIGMOBILE Mobile Computing and Communications Review, 6: 16-24, 2002.
Salovey, P. and Mayer, J., "Emotional intelligence. Imagina-tion, Cognition, and Personality," Cognition and Personality, 9: 185-211, 1990.
Steinhubl, S. R., Muse, E. D. and Topol, E. J., "Can Mobile Health Technologies Transform Health Care?," The Journal of the American Medical Association, 310: 2395-2396, 2013.
Su, S. C. Master. Taiwan: National Cheng Kung University; 2013. A Smartphone-based Daily Activity Monitoring System.
Torous, J., Friedman, R. and Keshavan, M., "Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions," JMIR Mhealth Uhealth, 2: e2, 2014.
Tu, H. Master. Taiwan: National Cheng Kung University; 2011. Development of an Activity Pattern Recognition System with Smartphone-Applying to Improve the Physical Activity of Overweight People.
Varshney, U., "Using wireless technologies in healthcare," International Journal of Mobile Communications, 4: 354-368, 2006.
Varshney, U., "Pervasive healthcare and wireless health monitoring," Mobile Networks and Applications, 12: 113-127, 2007.
World Health Organization, "Depression," In: 2012.
Zhang, Y., Tang, J., Sun, J., et al., "MoodCast: emotion prediction via dynamic continuous factor graph model," In: IEEE International Conference on Data Mining (ICDM), Sydney, Australia: IEEE, 1193-1198, 2010.
論文全文使用權限
  • 同意授權校內瀏覽/列印電子全文服務,於2017-08-27起公開。
  • 同意授權校外瀏覽/列印電子全文服務,於2017-08-27起公開。


  • 如您有疑問,請聯絡圖書館
    聯絡電話:(06)2757575#65773
    聯絡E-mail:etds@email.ncku.edu.tw