Vertolli, M.O., Kelly, M.A., & Davies, J. (2017). Coherence in the visual imagination. Cognitive Science. 42, 885--917.

• "Coherence" of an image is how realistic it looks. Specifically, this paper looks at which objects belong together in a scene.
• An implemented cognitive model is described that creates a coherent list of objects to be included in an imagined scene.

BibTex Entry:

@Article{Davies,
  author = 	 {Vertolli, Michael O. and Kelly, Michael, and Daves, Jim},
  title = 	 {Coherence in the visual imagination},
  journal = 	 {Cognitive Science},
  year = 	 {2017},
  volume = 	 {42},
  pages = 	 {885--917}
}

Download: [ PDF ]

Abstract

An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE’s original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that cooccurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard’s (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial. Keywords: Imagination; Coherence; Visualization; Cognitive modeling; Hippocampus