Evaluation Criteria

User Experience describes the overall user experience with regard to a product or service. This comprises: User expectations (anticipation), the usage situation and process itself and the impressions gained after the use (emotional identification or distancing).

The following evaluation criteria should be regarded as guidelines. They also support the judges in their individual decision-making process.

1. Essential Requirements for a Nomination

In order to be nominated for the competition, submissions must fulfill a majority of the the fundamental questions. This ensures that all nominees showcase a comparably high level of experience design.

The competition application must be self-explanatory and must clearly convey the user-centered approach that has been taken. The submission must solve a use challenge in a manner that is both elegant and useful.

2. Judging Criteria

Fundamental Questions

What is the objective of the product solution?

The objective of use and problem-solving potential must be clearly identifiable for the user.

Is the product straightforwardly accessible?

Access must be intuitive. All functions, assistance and feedback must be comprehensible and should support the user process.

Is the use sequence intuitive?

Information architecture, symbols and the use of color must be self-explanatory and contribute to intuitive user guidance that is consistent with user expectations. Thereby, learning time should be minimal.

Is the solution universally comprehensible?

A wide range of different users must be able to securely operate the product solution in various situational scenarios; errors must be easy to correct.

What assessment can be made of the emotional and cognitive aspects?

The sum of expectations, behaviors and reactions before, during and after use must be predominantly positive.

How have users been integrated into the development process?

The product development must be based on a user-centered process; the quality of the research methods and their subsequent integration are decisive for the success of the product.

Contents and Functions

Do the functions and media support the objectives of use?

The functions must correspond to the objectives of use; unnecessary actions and interactions should be avoided; appropriate information and media must support the communication objectives.

Are the contents appropriate?

The quality of the contents used must be in accordance with the context and objective of use.

Design and Service Quality

How well is the product designed?

The visual and formal design must be convincing and consistent. Form, function and used materials must be in an appropriate balance with one another.

Is the product customizable?

Adaptations to different expectations and user requirements should be facilitated.

Is a high service quality guaranteed?

The service must be coherent and offer a positive user experience across all touchpoints.

Innovation Value

Is the submission relevant?

The product must offer genuine added value for users, or should represent a significant improvement to an existing usage situation.

How innovative is the product solution?

The product should set new standards as a whole or in individual areas. This includes the successful utilization of technologies such as gesture and voice recognition, VR, AR and the attained degree of artificial intelligence (AI).