He, X., & Wu, D. (2023). Does additional audio really work? A study on users’ cognitive behavior with audio-visual dual-channel in panoramic digital museum.Information & Management, 60(4), 103791. http://doi.org/https://doi.org/10.1016/j.im.2023.103791

近日，中心2021级硕士研究生贺晓阳以第一作者身份在期刊Information & Management发表论文“Does additional audio really work? A study on users’ cognitive behavior with audio-visual dual-channel in panoramic digital museum”，通讯作者为吴丹教授。

Information & Management是图情领域顶级期刊，2021年影响因子为10.328，在SCI索引COMPUTER SCIENCE, INFORMATION SYSTEMS类别、SSCI索引INFORMATION SCIENCE & LIBRARY SCIENCE和MANAGEMENT类别均属于Q1分区。

Abstract

Multi-channel human-computer interaction offers a new perspective for optimization research in the digital museum, though there is no empirical evidence on how these factors affect cognition. This paper conducted a controlled experiment using the audio guide as a breakthrough point, aiming to determine the cognitive changes before and after the audio-visual dual-channel interaction. The results demonstrate that adding the auditory channel brought more cognitive load but not better cognitive outcomes. This paper evaluated the reasons behind it and noted that designing channels based solely on technical feasibility is undesirable, with suggestions proposed for museum practitioners and platform developers.

摘要

多通道的人机交互为全景数字博物馆优化研究提供了新的视角，但尚无实证证据表明这些元素如何影响认知。本文以语音导览为切入点，开展受控实验，旨在确定视听双通道交互前后的认知变化。结果表明，听觉通道的加入带来了更多认知负荷，却并未导致更好的认知效果。本文分析了背后的原因，指出仅基于技术可行性的通道设计是不可取的，并为博物馆从业者和平台开发者提出建议。