DERIS2010#

---

International Workshop on Design, Evaluation and Refinement of Intelligent Systems (DERIS)#

TU-Ilmenau
Ilmenau, Germany, September 13-17, 2010
http://deris2010.informatik.uni-wuerzburg.de

Co-located with 55th IWK, TU-Ilmenau

Background#

---

Evaluation, Verification, Validation and Refinement of Intelligent systems, have been an important issue from the very beginning of their applications. These issues were an important research area and engineering aspect in the 80's and 90's. A number of conceptual approaches as well as practical tools were developed then. With time the focus of research in the design of intelligent systems moved away from these topics, towards knowledge representation, discovery and processing, the Semantic Web technologies, and a number of other AI-inspired areas. However, recently a number of researchers have realized that the lack of systematic methods and formal techniques for the design, evaluation and refinement is often an important reasons for limited applications of even mature intelligent systems. Therefore, there is a growing need to reconsider some of the basic issues in this field.

Today, in fact, the classic approaches to the Desing, Evaluation, Verification, Validation and Refinement have to be assessed from the new perspectives in order to transfer their principles to new approaches and application fields. The practical design issues are of prime importance. The integration of Intelligent Systems with mainstream technologies and design approaches from other areas, e.g., from Software Engineering, from Machine Learning, or from the Social Sciences, is especially important. The quality issues need to be considered as early as possible during the Design phase of the system.

Aims and Scope#

---

The goal of the workshop is to promote community-wide discussion of ideas that will influence and foster continued research concerning the topics of Design, Evaluation, and Refinement, as well as attract new researchers to the field.

The objective is to focus on the contributions in the above fields and to provide an environment for communicating different paradigms and approaches, thus hopefully stimulating future cooperation and synergistic activities.

Topics of Interest#

---

Topics of interest include but are not limited to:

• Principles in knowledge systems and ontology design
• Detecting and handling inconsistencies and other anomalies within knowledge bases
• Fundamentals and formal methods for verification of AI systems
• Fundamentals and formal methods and techniques of validity assessment of AI systems, AI principles, and intelligent behavior in general
• Special approaches to verify and/or validate certain kinds of AI systems: rule-based, case-based,
• Special approaches or tools to evaluate systems of a particular application field
• Knowledge base refinement by using the results of evaluation
• Development and evaluation of ontologies
• Maintenance and evolution of knowledge systems and ontologies
• Explanation in the context of evaluation and assessment
• Problems in system certification
• Ontology and knowledge capture
• Design and evaluation issues in automatic knowledge capture and knowledge discovery
• Design and evaluation of semantic web applications and systems
• Formal methods in verification and evaluation of intelligent systems
• Case studies in design and evaluation and the lessons learned

Intended Audience#

---

We expect researchers and practitioners working on design, evaluation, and refinement issues in knowledge systems, e.g., from knowledge engineering, knowledge discovery, semantic web, social web, and web science. No limitation on the number of participants is planned.

Submission Details#

---

Authors are requested to initially submit complete manuscripts. However, draft versions of papers (work in progress, etc.) are also acceptable. The submitted works will be reviewed by at least two members of the program committee.

Papers should be formatted according to the IWK guidelines. The length of each paper should not exceed 6 pages for regular papers and 4 pages for short, or work in progress papers (including figures and references), see: http://www.tu-ilmenau.de/uni/fileadmin/Startseite/iwk10/submission/latex_templates_55iwk.zip. All papers must be written in English and submitted in PDF format.

Paper submission is a two-step process:

1. Extended Abstract Submission at the IWK-Website - Submission format: Word file.
   
2. Full Paper Submission via EasyChair - Submission format : See above.
   

Publication#

---

The abstracts of the papers will be published in an Abstract-Booklet of the IWK conference, and the full papers will be included in the printed IWK proceedings. Additionally, the full papers will be published online as CEUR proceedings http://ceur-ws.org after the event, edited by the workshop chairs.

A Journal Special Issue of selected and revised papers of two subsequent DERIS workshops is planned in 2010.

Important dates#

---

• Submission of extended abstracts: April 30, 2010
• Submission of full papers: May 01, 2010
• Notification of paper acceptance: May 31, 2010
• Camera ready copy submission: July 31, 2010
• The Workshop: September 13-17, 2010

Organization#

---

The workshop will be held with presentations of accepted papers. A comfortable time slot for discussion of all papers will be given.

Workshop Chairs#

M. Atzmueller, University of Kassel, Germany <atzmueller@cs.uni-kassel.de>
R. Knauf, TU Ilmenau, Germany <rainer.knauf@tu-ilmenau.de>

Program Committee (tentative)#

M. Atzmueller, University of Kassel, Germany
J. Baumeister, University Würzburg, Germany
S. Gaudl, Fraunhofer IDMT, Germany
A. Gonzalez, University of Central Florida, Florida, USA
K. P. Jantke, Fraunhofer IDMT, Germany
R. Knauf, TU Ilmenau, Germany
A. Ligêza, AGH UST Krakow, Poland
G. J. Nalepa, AGH UST, Krakow, Poland
Th. Roth-Berghofer, DFKI GmbH, Germany
D. H. Sleeman, University of Aberdeen, United Kingdom