Characterizing Human Expertise Using Computational Metrics of Feature Diagnosticity in a Pattern Matching Task

Cognitive Science 41 (7):1716-1759 (2017)
  Copy   BIBTEX

Abstract

Forensic evidence often involves an evaluation of whether two impressions were made by the same source, such as whether a fingerprint from a crime scene has detail in agreement with an impression taken from a suspect. Human experts currently outperform computer-based comparison systems, but the strength of the evidence exemplified by the observed detail in agreement must be evaluated against the possibility that some other individual may have created the crime scene impression. Therefore, the strongest evidence comes from features in agreement that are also not shared with other impressions from other individuals. We characterize the nature of human expertise by applying two extant metrics to the images used in a fingerprint recognition task and use eye gaze data from experts to both tune and validate the models. The Attention via Information Maximization model quantifies the rarity of regions in the fingerprints to determine diagnosticity for purposes of excluding alternative sources. The CoVar model captures relationships between low-level features, mimicking properties of the early visual system. Both models produced classification and generalization performance in the 75%–80% range when classifying where experts tend to look. A validation study using regions identified by the AIM model as diagnostic demonstrates that human experts perform better when given regions of high diagnosticity. The computational nature of the metrics may help guard against wrongful convictions, as well as provide a quantitative measure of the strength of evidence in casework.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 100,793

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Intuition Fail: Philosophical Activity and the Limits of Expertise.Wesley Buckwalter - 2016 - Philosophy and Phenomenological Research 92 (2):378-410.

Analytics

Added to PP
2016-11-10

Downloads
23 (#926,902)

6 months
7 (#653,123)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Chen Yu
NanJing University

References found in this work

A Mathematical Theory of Communication.Claude Elwood Shannon - 1948 - Bell System Technical Journal 27 (April 1924):379–423.
The base-rate fallacy in probability judgments.Maya Bar-Hillel - 1980 - Acta Psychologica 44 (3):211-233.
Perception below the Objective Threshold?Mark Van Selst & Philip M. Merikle - 1993 - Consciousness and Cognition 2 (3):194-203.
Computational Modelling of Visual Attention.Laurent Itti & Christof Koch - 2001 - Nature Reviews Neuroscience 2 (3):194–203.

View all 6 references / Add more references