학술논문

Scenario-based assessment of nonfunctional requirements
Document Type
Periodical
Source
IEEE Transactions on Software Engineering IIEEE Trans. Software Eng. Software Engineering, IEEE Transactions on. 31(5):392-409 May, 2005
Subject
Computing and Processing
System testing
Sociotechnical systems
Sequential analysis
Performance analysis
Computer network reliability
Humans
Computer networks
Bayesian methods
System performance
Benchmark testing
Index Terms- Nonfunctional requirements validation
scenario-based testing
Bayesian belief networks
systems engineering.
Language
ISSN
0098-5589
1939-3520
2326-3881
Abstract
This paper describes a method and a tool for validating nonfunctional requirements in complex socio-technical systems. The system requirements analyzer (SRA) tool validates system reliability and operational performance requirements using scenario-based testing. Scenarios are transformed into sequences of task steps and the reliability of human agents performing tasks with computerized technology is assessed using Bayesian belief network (BN) models. The tool tests system performance within an envelope of environmental variations and reports the number of tests that pass a benchmark threshold. The tool diagnoses problematic areas in scenarios representing pathways through system models, assists in the identification of their causes, and supports comparison of alternative requirements specifications and system designs. It is suitable for testing socio-technical systems where operational scenarios are sequential and deterministic, in domains where designs are incrementally modified so set up costs of the BNs can be defrayed over multiple tests.