Global Benchmark Database

Markus Iser; Christoph Jabs

doi:10.4230/LIPIcs.SAT.2024.18

Global Benchmark Database

Markus Iser, Christoph Jabs

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.

Original language	English
Title of host publication	27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024
Editors	Supratik Chakraborty, Jie-Hong Roland Jiang
Publisher	Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Publication date	Aug 2024
Article number	18
ISBN (Electronic)	978-3-95977-334-8
DOIs	https://doi.org/10.4230/LIPIcs.SAT.2024.18
Publication status	Published - Aug 2024
MoE publication type	A4 Article in conference proceedings
Event	International Conference on Theory and Applications of Satisfiability Testing - Pune, India Duration: 21 Aug 2024 → 24 Aug 2024 Conference number: 27

Publication series

Name	Leibniz International Proceedings in Informatics, LIPIcs
Volume	305
ISSN (Print)	1868-8969

Fields of Science

Maintenance and Distribution of Benchmark Instances and their Features
113 Computer and information sciences

Access to Document

10.4230/LIPIcs.SAT.2024.18Licence: CC BY

GlobalFinal published version, 701 KBLicence: CC BY

Next-generation Unsatisfiabillity-based Declarative Optimization
Järvisalo, M. (Project manager), Conati, A. F. (Participant), Eskelinen, V. (Participant), Feyzbakhsh Rankooh, M. (Participant), Jabs, C. J. (Participant) & Lehtonen, T. (Participant)
Academy of Finland
01/09/2023 → 31/08/2027
Project: Research Council of Finland: Academy Project

Cite this

Iser, M., & Jabs, C. (2024). Global Benchmark Database. In S. Chakraborty, & J.-H. R. Jiang (Eds.), 27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024 Article 18 (Leibniz International Proceedings in Informatics, LIPIcs; Vol. 305). Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing. https://doi.org/10.4230/LIPIcs.SAT.2024.18

@inproceedings{4afc9e5385b44a64b2689bf03ca2c503,

title = "Global Benchmark Database",

abstract = "This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.",

keywords = "Maintenance and Distribution of Benchmark Instances and their Features, 113 Computer and information sciences",

author = "Markus Iser and Christoph Jabs",

note = "Publisher Copyright: {\textcopyright} Markus Iser and Christoph Jabs.; International Conference on Theory and Applications of Satisfiability Testing, SAT ; Conference date: 21-08-2024 Through 24-08-2024",

year = "2024",

month = aug,

doi = "10.4230/LIPIcs.SAT.2024.18",

language = "English",

series = "Leibniz International Proceedings in Informatics, LIPIcs",

publisher = "Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing",

editor = "Supratik Chakraborty and Jiang, {Jie-Hong Roland}",

booktitle = "27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024",

address = "Germany",

}

Iser, M & Jabs, C 2024, Global Benchmark Database. in S Chakraborty & J-HR Jiang (eds), 27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024., 18, Leibniz International Proceedings in Informatics, LIPIcs, vol. 305, Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing, International Conference on Theory and Applications of Satisfiability Testing, Pune, India, 21/08/2024. https://doi.org/10.4230/LIPIcs.SAT.2024.18

Global Benchmark Database. / Iser, Markus; Jabs, Christoph.
27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024. ed. / Supratik Chakraborty; Jie-Hong Roland Jiang. Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing, 2024. 18 (Leibniz International Proceedings in Informatics, LIPIcs; Vol. 305).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Global Benchmark Database

AU - Iser, Markus

AU - Jabs, Christoph

N1 - Conference code: 27

PY - 2024/8

Y1 - 2024/8

N2 - This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.

AB - This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.

KW - Maintenance and Distribution of Benchmark Instances and their Features

KW - 113 Computer and information sciences

U2 - 10.4230/LIPIcs.SAT.2024.18

DO - 10.4230/LIPIcs.SAT.2024.18

M3 - Conference contribution

AN - SCOPUS:85203265369

T3 - Leibniz International Proceedings in Informatics, LIPIcs

BT - 27th International Conference on Theory and Applications of Satisfiability Testing, SAT 2024

A2 - Chakraborty, Supratik

A2 - Jiang, Jie-Hong Roland

PB - Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing

T2 - International Conference on Theory and Applications of Satisfiability Testing

Y2 - 21 August 2024 through 24 August 2024

ER -

Global Benchmark Database

Abstract

Publication series

Fields of Science

Access to Document

Projects

Next-generation Unsatisfiabillity-based Declarative Optimization

Cite this