Logo image
Exploratory Test-Driven Development Study with ChatGPT in Different Scenarios
Conference proceeding   Peer reviewed

Exploratory Test-Driven Development Study with ChatGPT in Different Scenarios

Juliano Cesar Pancher, J Melegati and Eduardo Martins Guerra
Agile Processes in Software Engineering and Extreme Programming: 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings, Vol.545, pp.145-159
Lecture Notes in Business Information Processing, 545
26th International Conference on Agile Software Development (Brugg-Windisch, 02/06/2025–06/06/2025)
2025
Handle:
https://hdl.handle.net/10863/49625

Abstract

Test-Driven Development TDD Generative AI ChatGPT Strategies
Generative AI has been rapidly adopted by the software development industry in various ways, offering innovative approaches to transforming requirements into working software. Combining Generative AI with Test-Driven Development (TDD) presents a creative method to accelerate this transformation. However, questions remain about ChatGPT’s readiness for this challenge, including the techniques and best practices required for success and the scenarios where this approach can consistently deliver results. To explore these questions, we designed a study where a group of master’s students performed programming assignments using TDD, first independently and then with the support of ChatGPT. The three assignments represent distinct scenarios: mathematical calculations (function), text processing (class), and system integration (class with dependencies). We performed a qualitative analysis of the submitted code and reports identifying key strategies that significantly influence success rates, such as providing contextual information, separating instructions in prompts following an iterative process, and assisting AI in fixing errors. Among the scenarios, the integration task achieved the highest performance. This study highlights the potential of leveraging Generative AI in TDD for software development and presents a list of effective strategies to maximize its impact. By applying these positive strategies and avoiding identified pitfalls, this research marks a step toward establishing best practices for integrating Generative AI with TDD in software engineering.
url
https://doi.org/10.1007/978-3-031-94544-1_10View

Details

Metrics

5 Record Views
Logo image