Search papers, labs, and topics across Lattice.
This paper introduces PICKLES, a domain-specific language extending Gherkin for specifying test scenarios in a structured natural language amenable to model-based testing. PICKLES enables bi-directional translation between human-readable specifications and formal models, facilitating the creation of a master model from which test cases can be automatically derived using standard MBT algorithms. An industrial case study on a traffic management system demonstrates that PICKLES achieves significantly higher coverage compared to standard BDD from the same set of scenarios.
Get significantly higher test coverage from your BDD scenarios by automatically translating them into formal models.
This paper combines methods from the fields of Model-Based Testing (MBT) and Behaviour-Driven Development (BDD) to define a testing approach with human-readable specifications and test cases, as in BDD, while using the modelling techniques and automatic test generation algorithms from MBT. We introduce PICKLES, a Precise Input and Control-flow Keyword-based Language for tEst Scenarios; an extension of Gherkin-style BDD scenarios, specified in structured natural language. We provide a bi-directional translation from Pickles scenarios to formal models, where both specifications and tests are human-readable, and a method to obtain a so-called master model combining all translated scenarios. Standard MBT algorithms can then be applied to automatically derive test cases from it. We implement a prototype of the translation and composition steps, which we use on an industrial case study: a software component from a traffic management system. With it, we illustrate the pipeline and show how Pickles can achieve significantly higher coverage with respect to BDD from the same set of scenarios.