Author(s): Michael Röder, Axel-Cyrille Ngonga Ngomo
Abstract: Linked Data is being increasingly adopted in the new data economy. As a corollary comes the development of many solutions that aim to support the booming number of requirements and requests for Linked Data at scale. This plethora of solutions however also leads to the growing need for objective means that facilitate the selection of adequate solutions for particular use cases. We hence present HOBBIT, a novel distributed benchmarking platform designed for the unified execution of benchmarks for distributed solutions that address the lifecycle of (Big) Linked Data. HOBBIT is based on the FAIR principles and is the first benchmarking platform able to scale up to benchmarking real-world scenarios for Big Linked Data solutions. The platform has already been used in eight benchmarking challenges. We give an overview of the results achieved duringthese challenges and point to some of the novel insights that were gained from the results of the platform. HOBBIT version 1.0.14 is open-source and available at http://github.com/hobbit-project.
Keywords: Benchmarking platform; Big Linked Data; Benchmarking distributed systems