Evaluation of Human-AI Interaction

🎯 Purpose: This study aims to understand how human-AI interactions are perceived from a human perspective.The purpose of the study is to identify what AI models lack and what they do well. Your participation will help us achieve this goal!

📋 What you'll do: In this survey, you will be given 5 "user query - AI response" pairs. Your task will be to carefully read each pair and answer some questions. (~10-15 minutes)

🔒 Privacy: Your answers and demographic information will be used for research purposes only and kept anonymous. Your participation is voluntary and you can withdraw at any time.

Study Consent & Confirmation

I confirm that my responses will be used for research purposes. (Required) I confirm to the collection and use of my demographic information for research purposes. (Required) I confirm that my participation in this study is voluntary and I can withdraw at any time. (Required) I have read and understood the purpose of this study. (Required)

Participant Demographic Information

This information will be used only for analysis purposes. You may answer "Prefer not to say" for any question.

Gender

Age

Country i

Please complete all required fields to begin.

Evaluation of Human-AI Interaction

In this survey, you will be given 5 user query – AI-generated response pairs.
🎯 Your task is to carefully read each pair in 1️⃣ User-AI Model Interaction, and then answer the questions in 2️⃣ Evaluation Questions based on the AI-generated response.
💡 Click the gray boxes under each question to see detailed descriptions and examples.
💡 There are no right or wrong answers to these questions. We encourage you to answer honestly, using your intuition and personal judgment.

Progress: 1 / 5

1️⃣ User-AI Model Interaction

id: 001

💡 Focus on the advice given by the AI model (especially suggested actions and recommendations).

2️⃣ Evaluation Questions

✅ You submitted your answers successfully!

Thank you for your time and thoughtful participation.

✅ Your MTurk completion code:

Paste this code into Mechanical Turk to receive payment.