Interactive IR User Study Design, Evaluation, and Reporting

Interactive IR User Study Design, Evaluation, and Reporting
Author :
Publisher : Springer Nature
Total Pages : 75
Release :
ISBN-10 : 9783031023194
ISBN-13 : 3031023196
Rating : 4/5 (196 Downloads)

Book Synopsis Interactive IR User Study Design, Evaluation, and Reporting by : Jiqun Liu

Download or read book Interactive IR User Study Design, Evaluation, and Reporting written by Jiqun Liu and published by Springer Nature. This book was released on 2022-05-31 with total page 75 pages. Available in PDF, EPUB and Kindle. Book excerpt: Since user study design has been widely applied in search interactions and information retrieval (IR) systems evaluation studies, a deep reflection and meta-evaluation of interactive IR (IIR) user studies is critical for sharpening the instruments of IIR research and improving the reliability and validity of the conclusions drawn from IIR user studies. To this end, we developed a faceted framework for supporting user study design, reporting, and evaluation based on a systematic review of the state-of-the-art IIR research papers recently published in several top IR venues (n=462). Within the framework, we identify three major types of research focuses, extract and summarize facet values from specific cases, and highlight the under-reported user study components which may significantly affect the results of research. Then, we employ the faceted framework in evaluating a series of IIR user studies against their respective research questions and explain the roles and impacts of the underlying connections and "collaborations" among different facet values. Through bridging diverse combinations of facet values with the study design decisions made for addressing research problems, the faceted framework can shed light on IIR user study design, reporting, and evaluation practices and help students and young researchers design and assess their own studies.


Interactive IR User Study Design, Evaluation, and Reporting Related Books

Interactive IR User Study Design, Evaluation, and Reporting
Language: en
Pages: 75
Authors: Jiqun Liu
Categories: Computers
Type: BOOK - Published: 2022-05-31 - Publisher: Springer Nature

DOWNLOAD EBOOK

Since user study design has been widely applied in search interactions and information retrieval (IR) systems evaluation studies, a deep reflection and meta-eva
Interactive IR User Study Design, Evaluation, and Reporting
Language: en
Pages: 95
Authors: Jiqun Liu
Categories: Computers
Type: BOOK - Published: 2019-06-04 - Publisher: Morgan & Claypool Publishers

DOWNLOAD EBOOK

Since user study design has been widely applied in search interactions and information retrieval (IR) systems evaluation studies, a deep reflection and meta-eva
A Behavioral Economics Approach to Interactive Information Retrieval
Language: en
Pages: 220
Authors: Jiqun Liu
Categories: Computers
Type: BOOK - Published: 2023-02-17 - Publisher: Springer Nature

DOWNLOAD EBOOK

This book brings together the insights from three different areas, Information Seeking and Retrieval, Cognitive Psychology, and Behavioral Economics, and shows
Understanding and Evaluating Search Experience
Language: en
Pages: 87
Authors: Stone Maria
Categories: Computers
Type: BOOK - Published: 2022-05-31 - Publisher: Springer Nature

DOWNLOAD EBOOK

This book is intended for anyone interested in learning more about how search works and how it is evaluated. We all use search—it's a familiar utility. Yet, f
Simulating Information Retrieval Test Collections
Language: en
Pages: 162
Authors: David Hawking
Categories: Computers
Type: BOOK - Published: 2022-06-01 - Publisher: Springer Nature

DOWNLOAD EBOOK

Simulated test collections may find application in situations where real datasets cannot easily be accessed due to confidentiality concerns or practical inconve