Preliminary Screening Survey

Preliminary Survey Screener v1

Main Github Repository

Section 1: Demographics and General Technology Use

1. Age

2. Gender

3. Highest level of education

4. Occupation

Section 2: General AI Experience

1. How familiar are you with Artificial Intelligence tools?

2. Which of the following AI-based tools have you used?

3. How often do you use AI-based tools in your daily life?

Section 3: Specific Experience with Large Language Models (LLMs)

1. Have you ever used a large language model (LLM) such as ChatGPT, GPT-3/4, or Bard?

• If Yes, how often do you use LLMs?

1. For what purposes have you used LLMs?

2. How would you rate your familiarity with the underlying technology of LLMs?

Section 4: Perception of Reliability and Trust in LLMs

1. How often do you fact-check information generated by LLMs?

2. In your opinion, how reliable do you think the information provided by LLMs is?

3. How confident are you in your ability to discern between accurate and inaccurate information generated by LLMs?

4. Have you encountered incorrect or misleading information from LLMs in the past?

• If Yes, how often do you encounter such errors?

1. When presented with information from LLMs, how do you usually verify its accuracy?

Section 5: Self-Assessment of Prior Experience Level

1. How would you rate your overall experience with AI tools (including LLMs)?

2. In comparison to others, how experienced do you feel in using AI technologies?

Scale Key

• Likert Scale:

1 = Not at all / No knowledge / Low 5 = Extremely / Very knowledgeable / High

---

• Multiple Choice (Frequency):

• Never,

• Less than once a week

• 1-3 times a week

• Almost every day

• Daily

Check All That Apply:

Used to select multiple options (e.g., tools or methods).

• Yes/No:

---

Binary response to indicate whether a participant has done something or encountered something.