Experience Evaluations for Human-Computer Co-Creative Processes - a Proposal

Human-computer co-creative software requires an evaluation perspective that better incorporates the experiences of the users. In this paper we propose an evaluation perspective based on user experience evaluation to evaluate the human-computer co-creative process. We apply this perspective into forming an evaluation plan for a human computer co-creative poetry writing system called the Poetry Machine. We feel that the inherently contextualized and subjective user experience perspective complements the commonly assumed positions of objectively evaluating the creative outcomes and the creative algorithmic processes in the domain of computational creativity applications. We first discuss the need for such an evaluation perspective and continue to present relevant evaluation metrics. We then outline an experiment in which we propose to use the said metrics to investigate differences in a human-computer co-creation process, a human-human co-creation process, and a human-human-computer co-creation process with the poetry writing system