Tracking human-centric controlled experiments with Biscuit
MetadataShow full item record
Software is created by humans, for humans. For this reason, software engineering is---above all---a human activity. Acknowledging this fact, many researchers perform controlled experiments with human subjects to evaluate the performance and usability of novel approaches and software engineering tools. However, the intrinsically non-deterministic nature of humans introduces a number of threats to the validity of such experiments. One of them concerns how to record information without influencing the behavior of the subjects involved. Another one relates to providing means to assure the correctness of the gathered data, for further pristine analyses and replication. We present Biscuit, a tool that silently records relevant pieces of information regarding an experiment performed with human subjects. We present the main features and benefits of Biscuit by showcasing a controlled experiment of Gaucho, a next generation IDE. Based on our experience, we discuss the potential of Biscuit and outline future research in this direction.
Showing items related by title, author, creator and subject.
Wettel R; Lanza M; Robbes R (ACM, 2011)Software visualization is a popular program comprehension technique used in the context of software maintenance, reverse engineering, and software evolution analysis. While there is a broad range of software visualization ...
Reggio G; Ricca F; Scanniello G; Dodero G; Di Cerbo F (Springer, 2011)We present a precise style for the modelling of business processes based on the UML activity diagrams and two controlled experiments to compare this style with a lighter variant. The comparison has been performed with ...
On the Comprehension of Workflows Modeled with a Precise Style: Results from a Family of Controlled Experiments Reggio G; Ricca F; Scanniello G; Dodero G; Di Cerbo F (Springer Verlag (Germany), 2015)In this paper, we present the results from a family of experiments conducted to assess whether the level of formality/precision in workflow modeling, based on UML activity diagrams, influences two aspects of construct ...