Search papers, labs, and topics across Lattice.
This paper extends the EvoMaster fuzzer to natively support OpenAPI Initiative (OAI) Overlay files, which allow testers to provide additional input data as "examples" to enhance black-box fuzzing of REST APIs. By conducting experiments on five diverse APIs from global enterprises, including Fortune 500 companies, the authors demonstrate that using Overlay files significantly improves the effectiveness of fuzz testing. The findings indicate that Overlay can mitigate the limitations of relying solely on OpenAPI schemas, thus offering a more robust approach to API testing in industry settings.
Overlay files can transform REST API fuzzing by enabling more effective black-box testing without vendor lock-in.
REST APIs are widely used in industry. Therefore, a lot of research has been focused on how to automatically generate test cases for REST APIs, with few different open-source fuzzers existing in the literature. For a thorough testing, especially in black-box scenarios, just relying on the information provided in the OpenAPI schemas is not enough. Testers typically need to provide extra input data to help steer the fuzzers in the right direction. Dedicated formats specific to each different fuzzer would work, but they would create a vendor lock-in, as well as increasing cognitive load. The OpenAPI Initiative (OAI) standard Overlay might be a solution to this problem. Such standard enables to define transformations on the OpenAPI schemas, where testers can provide input data in Overlay files where such data is provided as ``examples'' entries. In this paper, we have extended the state-of-the-art fuzzer EvoMaster to support Overlay files natively. Experiments are carried out in industry on five APIs from five enterprises from around the world (e.g., Belgium, China, Germany and T眉rkiye), including two Fortune500 enterprises as well as a 3-man startup. Our industrial results show that Overlay is a viable solution to better enable black-box fuzzing of REST APIs in industry.
