Test Tools and Automation

Assume you are the Test Manager in charge of independent testing for avionics applications.

You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):

- a BOOT-X CSCI that must be certified at level B of the DO-178B standard

- a DIAG-X CSCI that must be certified at level C of the DO-178B standard

- a DRIV-X CSCI that must be certified at level A of the DO-178B standard

These are three different software modules written in C language to run on a specific hardware platform.

You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.

Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).

The source code of the tool is available.

Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.

Which of the following are the three main concerns related to that open-source tool selection?

Number of correct responses: 3

K4 3 credits (2 credits out of 3 credits correct, 1 credit point)

Test Tools and Automation

Assume you are managing a test automation project for a mission-critical system.

Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework.

Which of the following management issues associated to the development of this custom automation framework is least likely to manage?

Number of correct responses: 1

K2 1 credit

Test Tools and Automation

After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project.

You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team.

In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures.

You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future.

Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?

Number of correct responses: 1

K2 1 credit

During the follow-up phase the following conditions are checked:

X1. The code has been completely reviewed

X2. All the identified defects have been correctly fixed and the modified code has been compiled successfully and run through all the static analyzers used by the project without warnings and errors

X3. The modified code is available under the configuration management system with a new version number for the specified CI

If these conditions are fulfilled then the review process terminates.

Which of the following characteristics of a formal review is missing in this description?

Number of correct responses: 1

K2 1 credit

You are using this skills assessment spreadsheet in order to define a training development plan for your test team.

Your objective is to fill the skill gaps by having at least a team member rated as an expert for each skill identified for the “technical expertise” and “testing skills” sections, and with the ability to train the other team members.

Considering the budget constraints you can send only one person to a training course.

Based only on the given information, which of the following answers would you expect to be the best option to achieve your objective?

Number of correct responses: 1

K4 3 credits

People Skills – Team Composition

Assume you are managing the system testing execution phase of a project.

The system test execution period for that project is scheduled for eighteen weeks and the release date is scheduled at the end of system testing.

During the sixth week of system test execution, at the staff meeting, the project manager informs you that the project deadlines are changed and the release date that is only three weeks ahead.

This new release will not allow the completion of the system tests. Suppose also that you have followed a risk-driven test approach for this project.

Which of the following statements represents the worst way to lead your test team in the next three weeks?

Number of correct responses: 1

K2 1 credit

People Skills – Team Composition

Which of the following would you expect to be most likely an example of a motivating factor for testers?

Number of correct responses: 1

K2 1 credit

Test Management

You are estimating the effort for the integration testing activities of a new project. Consider the following factors, which can affect that estimation:

I. Availability of re-usable test systems and documentation from previous, similar projects

II. Unexpected timing of components arrival

III. Stability of the integration test team (no turnover)

IV. Many and geographically distributed sub-teams

Which of the following statements is true?

Number of correct responses: 1

K2 1 credit

Test Management

For which of the following activities would the costs be classified as a cost of detection?

Number of correct responses: 1

K2 1 credit

Test Management

You are the Test Manager of a new project that will have three formal levels of testing: unit, integration and system testing. The testing strategy you decide to adopt a blend of risk-based testing and reactive testing strategies.

Which of the following answers describes the most consistent example of implementation of this test strategy during the execution of the system tests?

Number of correct responses: 1

K2 1 credit