Running Experiments with Confidence and Sanity

M Aumüller; Matteo Ceccarello

doi:10.1007/978-3-030-60936-8_31

Back

Running Experiments with Confidence and Sanity

Conference proceeding

Peer reviewed

Running Experiments with Confidence and Sanity

M Aumüller and Matteo Ceccarello

Similarity Search and Applications - 13th International Conference - SISAP2020, Vol.12440, pp.387-395

Lecture Notes in Computer Science

13th International Conference on Similarity Search and Applications, SISAP 2020 (Copenhagen, 30/09/2020 - 02/10/2020)

2020

DOI: https://doi.org/10.1007/978-3-030-60936-8_31

Handle:

https://hdl.handle.net/10863/32685

Abstract

Computer Science, Artificial Intelligence

Computer Science, Information Systems

Science & Technology

Computer Science

Technology

Analyzing data from large experimental suites is a daily task for anyone doing experimental algorithmics. In this paper we report on several approaches we tried for this seemingly mundane task in a similarity search setting, reflecting on the challenges it poses. We conclude by proposing a workflow, which can be implemented using several tools, that allows to analyze experimental data with confidence. The extended version of this paper and the support code are provided at https://github.com/Cecca/running-experiments.

Files and links (1)

url

https://doi.org/10.1007/978-3-030-60936-8_31View

Details

Title: Running Experiments with Confidence and Sanity
Creators: M Aumüller - IT University of Copenhagen
Matteo Ceccarello - Free University of Bozen-Bolzano
Publication Details: Similarity Search and Applications - 13th International Conference - SISAP2020, Vol.12440, pp.387-395
ISBN: 3030609359
9783030609351
EISBN: 3030609367
9783030609368
ISSN: 0302-9743
EISSN: 1611-3349
Conference: 13th International Conference on Similarity Search and Applications, SISAP 2020 (Copenhagen, 30/09/2020 - 02/10/2020)
Series / Volume: Lecture Notes in Computer Science
Publisher: Springer
Number of pages: 9
Identifiers: (UNIBZ)39159505
991006490497201241
Web of Science ID: WOS:000616694200031
Scopus ID: 2-s2.0-85093854900
Academic Unit: Faculty of Computer Science
Language: English
Resource Type: Conference proceeding
Author Names String: Aumüller M, Ceccarello M

Metrics

1 Record Views