TMMI_测试过程改进框架_已测量级别7_测试测量2

Specific Practices by Goals

SG 1 Align Test Measurement and Analysis Activities

保持测试测量和分析活动一致

Test measurement objectives and activities are aligned with identified information needs and objectives.

测试测量目标和行为保持一致，在验证的需求信息和目标方面。

SP 1.1 Establish test measurement objectives 建立测试测量目标

Test measurement objectives that are derived from identified information needs and business objectives are established and maintained. Example work products 1. Test measurement objectives 2. Information needs / test measurement objectives traceability matrix Sub-practices 1. Identify and select stakeholders that need to contribute to the identification of the information needs 2. Identify and document information needs and test measurement objectives using input from stakeholders and other sources 3. Prioritize information needs and test measurement objectives 。It may be neither possible nor desirable to subject all initially identified information needs to test measurement and analysis. Priorities may also need to be set within the limits of the available resources. 4. Review and update test measurement objectives The test measurement objectives are reviewed by management and other relevant stakeholders, and updated as necessary. Stakeholders are not only those that have the information needs, but should also include users of the test measurement and analysis results and possibly those who provide the test measurement data. 5. Maintain traceability of the test measurement objectives to the identified information needs There must always be a good answer to the question, “Why are we measuring this?”

测试测量目标被建立和维护，它是从已经验证的需要的信息和商业目标提取出来。

例子工作产品：测试测量目标，信息需求和测试测量目标可追溯矩阵。

子实践：1. 明确和选择相关利益人，他们需要对信息需求的验证做出贡献。2明确和文档化信息需求和测试测量目标，使用相关利益人的输入和其他资源。3.优先级划分信息需求和测试测量目标。可能既不可能也不可取提供所有的原始的验证的信息需求到测试测量和分析。分级设置被需要，考虑优先的资源。4.重审和更新测试测量目标。测试测量目标被管理者和其他相关利益人重审。必要时更新，相关利益人不仅仅是那些有信息需求的人，同时也包含测试测量和分析结果的人，可能那些提供测试测量数据的人也包含在内。5.维护测试测量目标的可追溯性到验证的信息需求。必须时时有一个答案来回答这个问题“为什么我们要测量这个东东？？？？？”

SP 1.2 Specify test measures 指出测试测量

The test measures are specified that will address the test measurement objectives. Test measures may be either “base” or “derived.” Data for base test measures are obtained by direct measurement. Data for derived test measures come from other data, typically by combining two or more base test measures. Example work products 1. Specification of test measures Sub-practices 1. Identify test measures based on documented test measurement objectives Examples of commonly used test measures include the following:  Estimates and actual measures of test effort and test cost  Estimates and actual measures of number of test cases  Number of defects by severity and/or priority  Total number of defects  Defect detection rate  Defect density  Peer review coverage  Structural coverage, e.g., code coverage  Requirements coverage  Reliability measures, e.g., Mean Time Between Failures (MTBF) and Mean Time To Repair (MTTR)  Burn down measurements, e.g., Test case execution rate per week 2. Document the test measures including their related test measurement objective 3. Specify operational definitions in exact and unambiguous terms for the identified test measures 4. Review and update the specification of test measures Proposed specifications of the test measures are reviewed and agreed for their appropriateness with potential end users and other relevant stakeholders and updated as necessary.

测试测量被指出用来跟踪测试策略目标。测试测量可能要么是基于数据要么是衍生数据来获得。

例子工作产品：1.测试测量说明书

子实践：1.明确测试测量，基于文档化的测试测量目标。通常使用的测试测量包括：评估和实际测试工作和测试消耗测量，评估和实际的测试用例的测量。按照严重性和优先级划分的缺陷个数，缺陷总数，缺陷发现率。缺陷密度，同行评审覆盖I率，结构覆盖率。需求覆盖率。可靠性测量，分解测量。2.文档化测试测量，包括它们相关的测试策略目标。3，指出操作定义使用精确的无歧义的措辞来来明确测试测量。4.重审和更新测试测量说明书

SP 1.3 Specify data collection and storage procedures 指出数据收集和存储过程

Collection methods are explicitly specified to ensure that the right data are collected properly. Storage and retrieval procedures are specified to ensure that data are available and accessible for future use. Example work products 1. Data collection and storage procedures 2. Data collection tools Sub-practices 1. Identify the measurement data that is currently not available for the identified test measures 2. Identify existing sources of the data Existing sources of data may already have been identified when specifying the test measures. 3. Specify how to collect and store the data for each required measure Explicit specifications are made of how, where, when and by whom the data will be collected. Procedures for collecting valid data are specified.Examples of topics that need to be included in the collection and storage procedures include the following:  Frequency of collection  Points in the process where data will be collected  Time lines and security rules for storing data  Responsibilities for obtaining the data and data storage (including security)  Links to supporting tools 4. Create data collection mechanisms and process guidance Data collection mechanisms may include manual or automated forms and templates. Clear, concise guidance on correct procedures is made available to those responsible for doing the work. Depending on the measurement objectives, related test measures and measurement data needed, a detailed defect classification scheme could be needed to address the test measurements process needs. Refer to SP 1.1 Define defect selection parameters and defect classification scheme of the Defect Prevention process area at TMMi level 5 for more information on a defect classification scheme. 5. Support automatic collection of the data where appropriate and feasible 6. Review data collection and storage procedures Proposed procedures are reviewed for their appropriateness and feasibility with those who are responsible for providing, collecting, and storing the data. 7. Update test measures and test measurement objectives as necessary Priorities may need to be reset based on the amount of effort required to obtain the data. Considerations include whether new forms, tools, or training would be required to obtain the data.

搜集方法被明确的指出来保证正确的数据被合理搜集，存储和回收过程被指出来保证数据在将来可用，可访问。

例子工作产品：数据搜集和存储流程，数据搜集工具

子实践：1.明确测量数据，数据在当前对于验证测试测量无效。2.明确已经存在的数据资源，现有的数据资源已经被验证当指出测试资源的时候。3.指出如何收集和存储数据对于每一个具体的测量。说明书被做来包含如何，哪里，什么时候或谁来搜集。搜集合理数据的流程被指出。包括：搜集频度，数据搜集流程的点，存储数据时间和安全规则，活动和存储数据的责任。4.生成数据搜集机制和过程到知道数据搜集。5.指出数据自动搜集6.重审数据搜集和存储过程。7实时更新

SP 1.4 Specify analysis procedures 指出分析过程

Data analysis procedures are specified in advance to ensure that appropriate analysis will be conducted, and reliable test measurement data is reported, to address the documented test measurement objectives. Example work products 1. Data analysis procedures 2. Data analysis tools Sub-practices 1. Specify the analysis that will be conducted and the reports that will be prepared The analysis should explicitly address the documented test measurement objectives. Presentation of the results should be clearly understandable by the stakeholders to whom the results are addressed. Priorities may have to be reset within available resources. 2. Select appropriate data analysis methods and tools Examples of issues to be considered when selecting appropriate data analysis methods and tools include the following:  Choice of visual display and other presentation techniques (e.g., pie charts, bar charts, histograms, line graphs, scatter plots, or tables)  Choice of appropriate descriptive statistics (e.g., arithmetic mean or median)  Decisions about statistical sampling criteria when it is impossible or unnecessary to examine every data element  Decisions about how to handle analysis in case of missing data elements  Selection of appropriate analysis tools  How to examine distributions on the specified test measures  How to examine interrelationships among the specified test measures 3. Specify administrative procedures for analyzing the data and communicating the results 4. Review and update the proposed content and format of the specified analysis procedures and communication reports 5. Update test measures and test measurement objectives as necessary Just as measurement needs drive data analysis, clarification of analysis criteria can affect measurement. Specifications for some measures may be refined further based on the specifications established for data analysis procedures. Other measures may prove to be unnecessary, or a need for additional measures may be recognized.

数据分析过程被首先指出来保证合适的分析被执行。可靠性测试测量数据被报告。来跟踪测试测量目标文档。

例子工作产品：数据分析流程，数据分析工具

子实践：1，指出将要执行的分析和将要准备的报告，分析需要明确的跟踪文档化的测试测量目标。结果报告需要明确的利益相关人理解。根据相关资源调整优先级。2.选择适当 数据分析方法和工具。3.指出管理流程来分析数据和沟通结果。4.重审和更新提出的内容和特定的分析流程的格式以及沟通报告。5。。。。