{"id":700,"date":"2017-12-21T13:44:26","date_gmt":"2017-12-21T12:44:26","guid":{"rendered":"https:\/\/testwebsite.2018.eswc-conferences.org\/?page_id=700"},"modified":"2017-12-21T13:47:48","modified_gmt":"2017-12-21T12:47:48","slug":"benchmarking-and-empirical-evaluation","status":"publish","type":"page","link":"\/subtracks\/benchmarking-and-empirical-evaluation\/","title":{"rendered":"Benchmarking and Empirical Evaluation"},"content":{"rendered":"<div id=\"pl-700\"  class=\"panel-layout\" ><div id=\"pg-700-0\"  class=\"panel-grid panel-has-style\"><div class=\"panel-row-style panel-row-style-for-700-0\"><div id=\"pgc-700-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-700-0-0-0\" class=\"so-panel widget widget_text panel-first-child panel-last-child\" data-index=\"0\" >\t\t\t<div class=\"textwidget\"><h2><strong>Description<\/strong><\/h2>\n<div class=\"textwidget\">\n<hr \>\n<p>The Semantic Web and Linked Data has been an active area of research for several years. For the first time, the 15th edition of the Extended Semantic Web conference runs the Benchmarking and Empirical Evaluation Track. Its goal is to provide a place for in-depth experimental studies and benchmarks of significant scale, which have been normally considered as part of the potential submissions in other regular tracks. It aims at promoting experimental evaluations in Semantic Web\/Linked Data research trying to create a research cycle between theory and experiments as in other sciences (e.g., physics).<br \>\nA typical paper for this track has to set its focus on the verification of an existing method by applying it to a specific task, and reporting the outcome of an experiment on an established or new dataset.<br \>\nPapers in this track can fit in different categories:<\/p>\n<ul style=\"padding-left: 90px;\">\n<li>Comparative evaluation studies comparing a spectrum of approaches to a particular problem and, through extensive experiments, providing a comprehensive perspective on the underlying phenomena or approaches.<\/li>\n<li>Analyses of experimental results providing insights on the nature or characteristics of studied phenomena, including negative results.<\/li>\n<li>Result verification focusing on verifying or refuting published results and, through the renewed analysis, help to advance the state of the art.<\/li>\n<li>Benchmarking, focusing on datasets and algorithms for comprehensible and systematic evaluation of existing and future systems.<\/li>\n<li>Development of new evaluation methodologies, and their demonstration in an experimental study<\/li>\n<\/ul>\n<\/div>\n<p>Public availability of experimental datasets is highly encouraged and will be considered in the evaluations, hence exceptions to this will need to be sufficiently justified.<br \>\nIn addition, these papers will be more specifically judged on the basis of their:<\/p>\n<div class=\"textwidget\">\n<ul style=\"padding-left: 90px;\">\n<li>Precise description of controlled experimental conditions<\/li>\n<li>Reproducibility<\/li>\n<li>Applicability range (broad coverage results being better than narrow applicability).<\/li>\n<li>Validity of the evaluation methodology (size of dataset, significance tests, ..)<\/li>\n<\/ul>\n<p>Special attention will be paid to reproducibility. Hence, experimental settings will have to be extensively described so that the results could be independently reproduced, so that counter-experiments could be designed and subsequent work is enabled to improve over the presented results.<br \>\nThe experimental approach is based on systematic scientific methods used in many disciplines. The page\u00a0<a href=\"http:\/\/explorable.com\/\" target=\"_blank\" rel=\"noopener\">http:\/\/explorable.com<\/a>\u00a0provides a good collection of methods, experiment design strategies, and resources.<\/p>\n<h2><\/h2>\n<p>&nbsp;<\/p>\n<h2><strong>Topics:<\/strong><\/h2>\n<div class=\"textwidget\">\n<hr \>\n<p>Topics of interest include, but are not limited to:<\/p>\n<ul style=\"padding-left: 90px;\">\n<li>Management of Semantic Web data and Linked Data<\/li>\n<li>Languages, tools, and methodologies for representing and managing Semantic Web data<\/li>\n<li>Database, IR, NLP and AI technologies for the Semantic Web<\/li>\n<li>Search, query, integration, and analysis on the Semantic Web<\/li>\n<li>Robust and scalable knowledge management and reasoning on the Web<\/li>\n<li>Cleaning, assurance, and provenance of Semantic Web data, services, and processes<\/li>\n<li>Semantic Web Services<\/li>\n<li>Semantic Sensor Web<\/li>\n<li>Semantic technologies for mobile platforms<\/li>\n<li>Evaluation of semantic web technologies<\/li>\n<li>Ontology engineering and ontology patterns for the Semantic Web<\/li>\n<li>Ontology modularity, mapping, merging, and alignment<\/li>\n<li>Ontology Dynamics<\/li>\n<li>Social and Emergent Semantics<\/li>\n<li>Social networks and processes on the Semantic Web<\/li>\n<li>Representing and reasoning about trust, privacy, and security<\/li>\n<li>User Interfaces to the Semantic Web<\/li>\n<li>Interacting with Semantic Web data and Linked Data<\/li>\n<li>Information visualization of Semantic Web data and Linked Data<\/li>\n<li>Personalized access to Semantic Web data and applicationsSemantic Web technologies for eGovernment, eEnvironment, eMobility or eHealth<\/li>\n<li>Semantic Web and Linked Data for Cloud environments<\/li>\n<\/ul>\n<p><strong>Acknowledgements<\/strong><br \>\nThe text from this CfP is partially based on the\u00a0<a href=\"http:\/\/iswc2013.semanticweb.org\/content\/call-evaluation-papers.html\" target=\"_blank\" rel=\"noopener\">Call for Evaluation Papers for ISWC 2013<\/a>\u00a0one by Chris Biemann and Josiane Xavier Parreira.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\t\t<\/div><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Description The Semantic Web and Linked Data has been an active area of research for several years. For the first time, the 15th edition of the Extended Semantic Web conference runs the Benchmarking and Empirical Evaluation Track. Its goal is to provide a place for in-depth experimental studies and benchmarks of significant scale, which have [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":155,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.6.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Benchmarking and Empirical Evaluation - 2018 ESWC-Conferences<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \>\n<link rel=\"canonical\" href=/wp-json/wp/v2/pages/700/\"\/subtracks\/benchmarking-and-empirical-evaluation\/\" \>\n<meta property=\"og:locale\" content=\"en_US\" \>\n<meta property=\"og:type\" content=\"article\" \>\n<meta property=\"og:title\" content=\"Benchmarking and empirical evaluation - 2018 eswc-conferences\" \>\n<meta property=\"og:description\" content=\"Description the semantic web and linked data has been an active area of research for several years. first time, 15th edition extended conference runs benchmarking empirical evaluation track. its goal is to provide a place in-depth experimental studies benchmarks significant scale, which have [&hellip;]\" \>\n<meta property=\"og:url\" content=\"\/subtracks\/benchmarking-and-empirical-evaluation\/\" \>\n<meta property=\"og:site_name\" content=\"2018 eswc-conferences\" \>\n<meta property=\"article:modified_time\" content=\"2017-12-21T12:47:48+00:00\" \>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"3 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"\/#website\",\"url\":\"\/\",\"name\":\"2018 ESWC-Conferences\",\"description\":\"15th ESWC 2018\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"\/subtracks\/benchmarking-and-empirical-evaluation\/#webpage\",\"url\":\"\/subtracks\/benchmarking-and-empirical-evaluation\/\",\"name\":\"Benchmarking and Empirical Evaluation - 2018 ESWC-Conferences\",\"isPartOf\":{\"@id\":\"\/#website\"},\"datePublished\":\"2017-12-21T12:44:26+00:00\",\"dateModified\":\"2017-12-21T12:47:48+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"\/subtracks\/benchmarking-and-empirical-evaluation\/\"]}]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"\/wp-json\/wp\/v2\/pages\/700"}],"collection":[{"href":"\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"\/wp-json\/wp\/v2\/comments?post=700"}],"version-history":[{"count":6,"href":"\/wp-json\/wp\/v2\/pages\/700\/revisions"}],"predecessor-version":[{"id":702,"href":"\/wp-json\/wp\/v2\/pages\/700\/revisions\/702"}],"up":[{"embeddable":true,"href":"\/wp-json\/wp\/v2\/pages\/155"}],"wp:attachment":[{"href":"\/wp-json\/wp\/v2\/media?parent=700"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}