Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Personality Factors in Human Deception Detection: Comparing Human to Machine Performance

Frank Enos (1), Stefan Benus (1), Robin L. Cautin (2), Martin Graciarena (3), Julia Hirschberg (1), Elizabeth Shriberg (3)

(1) Columbia University, USA; (2) Manhattanville College, USA; (3) SRI International, USA

Previous studies of human performance in deception detection have found that humans generally are quite poor at this task, comparing unfavorably even to the performance of automated procedures. However, different scenarios and speakers may be harder or easier to judge. In this paper we compare human to machine performance detecting deception on a single corpus, the Columbia-SRI-Colorado Corpus of deceptive speech. On average, our human judges scored worse than chance - and worse than current best machine learning performance on this corpus. However, not all judges scored poorly. Based on personality tests given before the task, we find that several personality factors appear to correlate with the ability of a judge to detect deception in speech.

Full Paper

Bibliographic reference.  Enos, Frank / Benus, Stefan / Cautin, Robin L. / Graciarena, Martin / Hirschberg, Julia / Shriberg, Elizabeth (2006): "Personality factors in human deception detection: comparing human to machine performance", In INTERSPEECH-2006, paper 1664-Tue1A3O.6.