利用視覺資訊的情境感知應用平台｜國立臺灣科技大學博碩士論文系統

簡易檢索 / 詳目顯示

回結果列表

研究生：	林昭源 Zhao-Yuan Lin
論文名稱：	利用視覺資訊的情境感知應用平台 Residential Context-Aware Application Platform with Vision Sensors
指導教授：	鄧惟中 Wei-Chung Teng
口試委員:	鍾聖倫 Sheng-Luen Chung 鄭憲宗 Sheng-Tzong Cheng 鄭伯順 Bo-Shun Cheng 郭景明 Jing-Ming Guo
學位類別：	碩士 Master
系所名稱：	電資學院 - 資訊工程系 Department of Computer Science and Information Engineering
論文出版年：	2009
畢業學年度：	97
語文別：	英文
論文頁數：	78
中文關鍵詞：	情境感知、開放式服務平台、人物追蹤、智慧家庭、事件發佈與訂閱
外文關鍵詞：	context-aware, OSGi, person tracking, smart home, event publish/subscribe
相關次數：	點閱：287 下載：1
分享至:	分享至facebook 分享至twitter

查詢本校圖書館目錄查詢臺灣博碩士論文知識加值系統勘誤回報

本篇論文提出了一個在智慧型家庭系統上的居家環境的情境感知設計平台，只要情境感知規則符合我們所定義的樣板的條件規則，我們就有辦法處理並且將之系統化。此系統是建置在OSGi的平台上，所以對於其他的家庭服務也可輕易的取用與整合。另外，為了將家庭成員的背景情境特徵化為實體資訊，本論文也實做了一個居家環境的追蹤系統，稱為COTS (Configurable Occupant Tracking System)，此系統可以萃取居民的背景資訊，進而提供給我們的情境感知平台做決策，再呼叫相關的OSGi服務。我們也設計了一個智慧型的DVR (digital video recording)系統，會自動偵測人物進出場景的精確時間，讓我們擁有便利的瀏覽與播放人物追蹤結果的功能。在接收與傳送情境感知資訊方面，我們也採用了訊息導向中介軟體 (MOM)，並且讓每個模組都是利用一個事件發佈與訂閱方法的程式樣板來實作。最後，我們設計了一個情境感知的劇本，並且整合智慧型家庭所有的服務，成功的展示本平台可將各種情境感知服務融入智慧型家庭之中。

This thesis proposes a residential context-aware application platform for smart home system by which context-aware rules that are consistent with the rule template we defined can be handled systematically. Our system is built upon the basis of OSGi platform such that other family service modules can easily be ported and integrated with our system. In addition, our research developed a residents tracking system called COTS to characterize the situation of an entity on occupants in home environment. COTS can obtain contextual information from residents and help the context-aware platform to process decision-making and to invoke related OSGi service. We also designed a smart DVR (digital video recording) module which automatically detects the shot boundary of occupants and let us conveniently browse/navigate features of tracking result. On the other hand, to receive and to transmit the contextual information, our system also adopts MOM (message oriented middleware), and each module is implemented to utilize event publish/subscribe messaging mechanism. Finally, we designed a scenario to demonstrate how we successfully implemented a variety of intelligent context-aware services in a residential environment.

Abstract	I
摘要	II
誌謝	III
Table of Contents	IV
List of Figures	VIII
List of Tables	XI
Chapter 1.	Introduction	1
1.	Context-Aware Computing	1
1.1.	Context	1
1.2.	Vision Sensors	2
1.3.	Context by Camera Information	3
1.4.	Vision Sensor Technology	3
2.	Literature Survey	4
2.1.	The Context-aware Event Table	9
3.	Motivation	10
3.1.	Desiderate	11
3.2.	Research Objectives	11
4.	Technical Challenges	12
5.	Contributions	13
6.	Thesis Organization	14
Chapter 2.	Configurable Occupant Tracking	15
1.	Functional Requirements	15
1.1.	Definition of Configurable Occupant Tracking System (COTS)	15
1.2.	COTS Functions	16
1.3.	Smart Home Layout	17
1.4.	Setting up the Surveillance System	17
2.	FSM Modeling for Occupant Tracking	19
3.	Modules of COTS	21
4.	Image Processing of Vision Sensor	22
4.1.	Extraction of Foreground Image	23
4.2.	Blob Detection and Classification	27
4.3.	Projection to the Physical Location	30
4.4.	Position Tracking	32
5.	Coordination of all Vision Sensors	33
5.1.	Multiple Cameras in a Room	33
5.2.	Multiple Rooms on a Floor Plan	34
6.	Occupant Tracking Annotation	36
6.1.	Adjust the Differences of Camera Views Smartly	36
6.2.	To Chain Video Clips by Shot Boundary Detection	37
Chapter 3.	Residential Context-Aware Framework	40
1.	Contextual Applications	40
1.1.	Contextual Information and Commands	40
1.2.	Services Options	41
2.	Rule Formulation	43
2.1.	Define the Rule Formulation	43
2.2.	Types of Rules	43
2.3.	Relations of Variables in COTS	46
3.	Rule-based Engine	46
3.1.	Functions of the Rule-based Engine	47
3.2.	Editing Rules	48
3.3.	Mechanism of Invoking Services	49
Chapter 4.	OSGi-Compliant Context-aware Platform	51
1.	Taiwan Tech MyHome	51
1.1.	OSGi Platform and Service Bundles	52
1.2.	MOM: ActiveMQ for Programming Template	54
2.	Design Overview of the Rule-based Engine Module	55
2.1.	Rule-based Engine Module Design	55
2.2.	Rules Entering Process	55
2.3.	How the Services Registered and Linked to the Rule-based Engine Module	56
2.4.	The Variables of COTS and Sensors	57
2.5.	How the Event Variables Linked to the Rule-based Engine Module…	57
3.	Service Invocation by Contextual Rules	59
3.1.	Event-Update Notification to Rule-based Engine	60
3.2.	Service Invocation in OSGi Service Registry	61
4.	Integration of Context-Aware System	62
4.1.	Rule Example: Bounding with CTOS and Regular Habits	64
Chapter 5.	Demonstration	66
1.	The Environment	66
2.	Annotated Occupant Tracking	67
3.	Residential Context-Aware Scenarios	68
Chapter 6.	Conclusions	72
1.	Comparisons to Existing Solutions	72
2.	Contributions	73
3.	Future Work	73
References	76

                                

[1] G. Chen and D. Kotz, “A Survey of Context-aware Mobile Computing Research,” Technical Report TR2000-381, Dartmouth College, Computer Science, 2000.
[2] B. Schilit, N. Adams, and R. Want, “Context-aware Computing Applications,” in Proceedings of IEEE Workshop on Mobile Computing Systems and Applications, pp. 85-90, 1994.
[3] I. Haritaoglu, D. Harwood, and L. S. Davis, “W4: Real-time Surveillance of People and Their Activities,” IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809–830, 2000.
[4] D. P. Siewiorek, A. Smailagic, J. Furukawa, A. Krause, N. Moraveji, K. Reiger, J. Shaffer, and F. L. Wong, “SenSay: a Context-aware Mobile Phone,” in Proceedings of the 7th IEEE International Symposium on Wearable Computers, pp. 248–249, 2003.
[5] T. Broens, A. V. Halteren, M. V. Sinderen, and K. Wac, “Towards an Application Framework for Context-aware M-health Applications,” International Journal of Internet Protocol Technology, vol. 9, no. 2, pp. 109-116, 2007.
[6] W. R. Jih, S. Y. Cheng, and Y. J. Hsu, “Context-aware access control on pervasive healthcare,” in Proceedings of IEEE’05 Workshop: Mobility, Agents, and Mobile Services, pp. 21-28, 2005.
[7] Open Services Gateway Initiative alliance, http://www.osgi.org .
[8] D. Marples and P. Kriens, “The Open Services Gateway Initiative: An Introductory Overview,” In Proceedings of IEEE Comm. Magazine, vol. 39, no. 12, pp. 110-114, 2001.
[9] J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale and S. Shafer, “Multi-Camera Multi-Person Tracking for EasyLiving,” in Proceedings of the Third IEEE International Workshop on Visual Surveillance, pp. 3-10, 2000.
[10] D. Chen, A.J. Bharucha and H.D. Wactlar, “Intelligent Video Monitoring to Improve Safety of Older Persons,” in Proceedings of IEEE Engineering in Medicine and Biology Society, pp. 3814-3817, 2007.
[11] Z. Zhou, X. Chen, Y. C. Chung, Z. He, T. X. Han, and J. M. Keller, “Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring,” IEEE Transaction on Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1489-1498, 2008.
[12] C.Wren, R. Christopher, Azarbayejani, Ali, Darrell, Trevor, and Pentland, Alex, “Pfinder: Real-Time Tracking of the Human Body,” IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, 1997.
[13] N. Friedman and S. Russell, “Image Segmentation in Video Sequences: Probabilistic Approach,” In Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence, pp. 1-3, 1997.
[14] O. Javed, K. Shafique, and M. Shah, “A Hierarchical Approach to Robust Background Subtraction Using Color and Gradient Information,” In Proceedings of the Workshop on Motion Video Computing, pp. 22-27, 2002.
[15] E. Durucan and T. Ebrahimi, “Change Detection and Background Extraction by Linear Algebra,” in Proceedings of the IEEE, vol.89, no.10, pp.1368-1381, 2001.
[16] T. Horprasert, D. Harwood, and L.S. Davis, “A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection,” in Proceedings of the IEEE International Conference on Computer Vision ’99 FRAME-RATE Workshop, 1999.
[17] R. Cucchiara, M. Piccardi, and A. Prati, “Detecting Moving Objects, Ghosts, and Shadows in Video Streams,” in Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1337-1342, 2003.
[18] R. Polana and R. Nelson, “Low Level Recognition of Human Motion,” in Proceedings of the IEEE Workshop on Motion of Non-Rigid and Articulated Objects, Austin, TX, pp. 77-82, 1994.
[19] A. K. Dey, “Understanding and Using Context,” Personal Ubiquitous Computing, vol. 5, no.1, pp. 4–7, 2001.
[20] Rafael C Gonzalez and Richard E. Woods, “Digital Image Processing”.
[21] Swain, M., and D. Ballard, “Color Indexing,” International Journal of Computer Vision, vol. 7, no. 1, pp. 11–32 ,1991.
[22] Apache ActiveMQ, http://activemq.apache.org/
[23] Open Services Gateway Initiative alliance, http://www.osgi.org
[24] H. Lee, A. F. Smeaton, C. O'Toole, N. Murphy, S. Marlow and N. E. O'Connor, ”The Físchlár Digital Video Recording, Analysis, and Browsing System,” in Proceedings of RIAO '2000: Content-Based Multimedia Information Access, pp. 12-14, Paris, France, 2000.
[25] K. Skifstad and R. Jain, “Illumination Independent Change Detection for Real World Image Sequences,” Computer Vision, Graphics, and Image Processing, vol. 5, no 3, pp. 387-399, 1989.
[26] 鍾聖倫，包宇駿，＜智慧家庭中家庭服務閘道的設計與實現＞，國立臺灣科技大學電機工程系碩士學位論文(2008)。
[27] 鍾聖倫，鄧惟中，黃炫諭，＜植基於OSGi的智慧家庭全覽系統＞，國立臺灣科技大學資訊工程系碩士學位論文(2009)。
[28] 鍾聖倫，林哲宏，＜利用群組攝影機所作的建築內行人追蹤＞，國立臺灣科技大學電機工程系碩士學位論文(2009)。
[29] R. Szeliski, “Video Mosaics for Virtual Environments,” IEEE Computer Graphics and Applications, vol. 16, no. 2, pp.22-30, 1996.

簡易檢索 / 詳目顯示

相關論文