簡易檢索 / 詳目顯示

研究生: 陳昭斌
Chao-Pin Chen
論文名稱: 整合軟體驗證與確認流程與產出之品質評估模式
A Quality Assessment Model That Integrates The Processes And Outputs Of Software Verification And Validation
指導教授: 黃世禎
Sun-Jen Huang
口試委員: 李漢銘
Hahn-Ming Lee
陳振楠
Jenn-Nan Chen
學位類別: 碩士
Master
系所名稱: 管理學院 - 資訊管理系
Department of Information Management
論文出版年: 2006
畢業學年度: 94
語文別: 中文
論文頁數: 125
中文關鍵詞: 度量與分析流程與產品品質保證軟體品質保證確認能力成熟度整合模式驗證
外文關鍵詞: Process and Product Quality Assurance, PPQA, SQA, Software Quality Assurance, Verification, Capability Maturity Model Integrated
相關次數: 點閱:445下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 軟體驗證(Verification)和確認(Validation)的目標是要找出軟體產品中的缺失並移除缺失,以期軟體產品能夠符合顧客品質的要求,因此有效的驗證與確認工作,對軟體產品品質的確保有莫大的助益。在衡量驗證與確認的效能時,多數的研究採用缺失移除效能(Defect Removal Effectiveness, DRE)做為度量指標,蒐集軟體開發階段與產品上市之後所發現的缺失數目,以評估開發階段所執行之驗證與確認的有效性。然而,缺失移除效能很明顯地是個落後指標(lagging indicator),必須等待產品交付給客戶一段時間後,才能夠反應出驗證與確認工作執行的品質。因此若僅僅仰賴落後指標,將會產生無法即時反應缺失的風險,疏漏了潛在的產品缺失至顧客使用者的手中,而造成巨額的不良品質成本。
    平衡計分卡認為,績效的衡量必須適當地整合落後指標與領先指標,而領先指標衡量的對象為當下的行動與績效的驅動因子。能力成熟度整合模式 (Capability Maturity Model Integration, CMMI) 的「流程與產品品質保證」流程領域強調必須同時客觀地評估流程與產品的品質。基於以上的想法,本研究提出除了評估軟體產品缺失外,也必須同時評估偵測移除軟體缺失的流程-也就是「驗證」與「確認」。因此為了客觀地評估驗證與確認的作業流程,本研究設計了驗證與確認活動的查核表、回饋量表與一系列的度量指標集 (Software Metrics),支援驗證與確認活動的執行,蒐集驗證與確認活動的度量值資料,與評估驗證與確認活動的完整性與適切性;再配合分析工作產品在驗證與確認活動時所發現的缺失,軟體開發專案得以在工作產品交付給客戶之前,有系統地評估工作產品的品質,從而擬定合適的品質改善策略與協助專案做合適的決策。


    The aim of Verification and Validation is to detect software defects and remove them, and further ensure that the delivered software product meets users' quality requirements and operation expectation. Thus, effective verification and validation processes can benefit a lot to the quality of software products. When measuring the effectiveness of verification and validation activities, most existing researches used the defect removal effectiveness (DRE) as an indicator. Such an indicator needs the defect data removed within the development phases and after the delivery. However, it is obvious that DRE is a legging indicator and its value can only be computed a certain time period after the software delivers to users. If this is the only indicator to rely on, there would be risky that the project team is unable to reflect the real effectiveness of verification and validation processes in time. The project team might leak potential software defects to customers and thereby cause a huge amount of cost of poor quality.
    One of key concepts of Balanced Scorecard is to balance lagging indicators with leading indicators, which attempt to quantify future results based on current actions and performance drivers. The “Process and Product Quality Assurance” process area in CMMI model emphasizes that both processes and work products should be objectively evaluated. Based on the above thought, this thesis proposes that besides evaluating software defects, we must also evaluate the defect detection and removal processes, which are Verification and Validation. Therefore, in order to objectively evaluate the verification and validation activities, the thesis presents the observation checklists for evaluating verification and validation activities, scoring questionnaires for getting the feedbacks on performing verification and validation activities, and a set of software metrics for measuring verification and validation activities. The proposed checklists, questionnaires and software metrics can help to collect the measurement data, and analyze the completeness and adequacy of the verification and validation activities. Together with the defect data found and fixed in the verification and validation processes, software project is able to systematically analyze the quality of work products before they are delivered to customers. And project managers can accordingly develop appropriate quality improvement strategy and also make adequate decisions in the improvement of the verification and validation processes.

    摘 要 I ABSTRACT III 誌 謝 V 目 錄 VII 表 目 錄 IX 圖 目 錄 XI 第一章 緒論 1 1.1研究背景 1 1.2研究動機 2 1.3研究目的 5 1.4研究架構及步驟 6 1.5研究範圍與前提 9 1.6本文架構 9 第二章 文獻探討 11 2.1軟體驗證與確認流程相關文獻探討 11 2.1.1 軟體驗證與確認的定義 11 2.1.2 軟體驗證與確認的活動 12 2.1.3 常見的品質度量指標 19 2.1.4 軟體驗證與確認活動效能的度量 21 2.2軟體品質保證相關文獻探討 25 2.3流程效能的相關文獻探討 27 2.4心得討論 28 第三章 研究方法及研究工具 29 3.1研究步驟 29 3.1.1 準備階段 29 3.1.2 資料蒐集階段 30 3.1.3 資料分析階段 32 3.2軟體檢驗活動查核表 33 3.3軟體測試活動查核表 40 3.4軟體驗證與確認活動回饋量表 44 3.4.1 收集回饋資料的目的 44 3.4.2 蒐集回饋的時機 45 3.4.3 回饋蒐集方式與回饋量表 47 3.4.4 分析方式 54 3.5度量指標集 55 3.5.1 驗證與確認活動的完整性相關度量指標 57 3.5.2 驗證與確認活動的工作量及相關度量指標 67 3.6整合驗證與確認的流程與產出之品質評估模式 91 第四章 研究結果與分析 95 4.1 個案公司與專案的介紹 95 4.2 A專案-需求的驗證與確認 96 4.2.1 A專案需求檢驗研究結果 96 4.2.2 A專案的分析與評估 99 4.3.1 B專案Alpha測試研究結果 102 4.3.2 B專案的分析與評估 108 第五章 結論與建議 111 5.1研究貢獻 111 5.2研究困難與後續研究建議 112 參考文獻 115 I. 中文部分 115 II. 英文部分 115 附錄A、軟體檢驗活動查核表與CMMI的對照 119 附錄B、軟體測試活動查核表與CMMI的對照 121 附錄C、中英對照 123 作者簡介 125

    I. 中文部分
    [1] Robert S. Kaplan, David P. Norton 著,朱道凱 譯,「平衡計分卡:資訊時代的策略管理工具」,臉譜文化,民國88 年。
    [2] 克勞斯比(Philip B. Crosby)著,陳怡芬 譯,「不流淚的品管」,天下文化,民國84 年。
    [3] 史蒂芬。柯維(Stephen R. Covey)著,顧淑馨 譯,「與成功有約」,天下文化,民國84 年。
    [4] Jack J. Phillips, Timothy W. Bothell, G. Lynne Snead 著,劉孟華譯,「專案管理計分卡:評估專案管理解決方案的最佳策略工具」,臉譜文化,民國94 年。
    [5] 陳俊彥,「以量化軟體度量指標支援CMMI 模式的導入與評鑑」,碩士論文,國立台灣科技大學資訊管理研究所,民國91年。
    II. 英文部分
    [6] International Standard Organization, “ISO/IEC 12207: 1995, Information Technology – Software Life Cycle Processes”, 1995
    [7] IEEE-SA Standards Board, “IEEE Standard for Software Verification and Validation”, IEEE Std 1012-1998, 1998
    [8] Carnegie Mellon University Software Engineering Institute, “Capability Maturity Model Integration v1.1”, CMMI–SW/SE, Continuous representation, 2002
    [9] Carnegie Mellon University Software Engineering Institute, “The Capability Maturity Model: Guidelines for Improving the Software Process”, Addison-Wesley, 1994
    [10] IEEE Standards Board, “IEEE Guide for Software Quality Assurance Planning”, IEEE Std 730.1-1995, 1995
    [11] IEEE-SA Standards Board, “IEEE Standard for Software Quality Assurance Plan”, IEEE Std 730-2002, 2002
    [12] IEEE-SA Standards Board, “IEEE Standard for Software Test Documentation”, IEEE Std 829-1998, 1998
    [13] S. Kan, “Metrics and Models in Software Quality Engineering”, Second Edition, Addison Wesley, 2003
    [14] A. Abran, J. W. Moore, P. Bourque, R. Dupuis, & L. L. Tripp, “Guide to the Software Engineering Body of Knowledge: 2004 Version”, IEEE Computer Society, 2004
    [15] Institute of Electrical and Electronics Engineers, “IEEE Standard Dictionary of Measures to Produce Reliable”, IEEE Std 982.1-1988, June, 1988
    [16] Fagan, M. E., “Design and Code Inspections to Reduce Errors in Program Development,” IBM Systems Journal, Vol. 15, No. 3, 1976
    [17] Jones, C., “Programming Productivity”, New York: McGraw-Hill, 1986
    [18] Dunn, R. H., “The Quest for Software Reliability”, in G.G. Schulmeyer & J.I. McManus (Eds.), Handbook of Software Quality Assurance, pp. 342–384, Van Nostrand-Reinhold Company, New York, 1987
    [19] Daskalanatonakis, M. K., “A Practical View of Software Measurement and Implementation Experiences within Motorola”, IEEE Transactions on Software Engineering, Vol. SE-18, 192
    [20] Ebenau, R. G. & Strauss, S. H., “Software Inspection Process”, New York: McGraw-Hill, 1994
    [21] Members of the Assessment Method Integrated Team, “Standard CMMI® Appraisal Method for Process Improvement (SCAMPISM), Version 1.1: Method Definition Document”, Carnegie Mellon University, CMU/SEI-2001-HB-001, December 2001
    [22] Ferguson, J., “Updated SCAMPISM A Practice Characterization and Aggregation Rules”, SEISM Appraisal Program Communication, SCAMPI-N-0013, Carnegie Mellon University, October 2005
    [23] International Standard Organization, “ISO/IEC TR 9126-2: 2003, Software Engineering – Product Quality – Part 2: External Metrics”, 2003
    [24] International Standard Organization, “ISO/IEC TR 9126-3: 2001,
    Software Engineering – Product Quality – Part 3: Internal Metrics”, 2001
    [25] T. W. Williams, M. R. Mercer, J. P. Mucha, and R. Kapur, “Code coverage: what does it mean in terms of quality?”, Proceedings of the Annual Reliability and maintainability Symposium, pp 420-424, Philadelphia, PA, USA, January 2001
    [26] Watts S. Humphrey, “Introduction to the Team Software Process”, Addison Wesley, 2000
    [27] Watts S. Humphrey, “PSP: a self-improvement process for software engineers”, Addison Wesley, 2005
    [28] D. H. Besterfield, C. Besterfield-Michina, G. H. Besterfield, M. Besterfield-Sacre, “Total Quality Management”, third edition, Pearson Education, 2003

    無法下載圖示
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE