Journal Article: “College Students’ Credibility Assessments Of GenAI-Generated Information For Academic Tasks: An Interview Study”
The article linked below was recently published by JASIST (Journal of the Association For Information Science and Technology)
Title
Authors
Wonchan Choi
University of Wisconsin-Milwaukee
Hyerin Bak
University of Wisconsin-Milwaukee
Jiaxin An
University of Texas at Austin
Yan Zhang
University of Texas at Austin
Besiki Stvilia
Florida State University
Source
JASIST (Journal of the Association For Information Science and Technology)
DOI: 10.1002/asi.24978PDF
Abstract
The study explored college students’ use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI-generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students’ motivation and ability to assess the credibility of GenAI-generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter- and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI-generated information. This study provides theoretical and empirical findings regarding students’ use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.
Direct to Article (Abstract Only)
NOTE: An approved for publication preprint version of the article is also available
(34 pages; PDF); via: Co-author
Filed under: Data Files, Interviews, Journal Articles, News, Profiles, Reports
About Gary Price
Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. He earned his MLIS degree from Wayne State University in Detroit. Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com.