AI and Survey Sampling Problems

My previous post discussed the performance of the artificial intelligence (AI) interface Gemini on undergraduate statistics problems. Now let’s look at how Gemini answers some of the problems in my sampling textbook (Lohr, 2022), and talk about how Gemini could help students learn sampling.Evaluate a Survey QuestionQuery: Evaluate the following survey question for the purpose of estimating the number of American adults who have seen the movie Citizen Kane: "According to the American Film Institute, Citizen Kane is the greatest American movie ever made. Have you seen this movie?" This is Exercise 32(b) on page 27 of Lohr (2022). My solution manual gives the following answer: “This is a leading question; after being told that it is the greatest American movie ever made, respondents will be loath to say they have not seen it.” But Gemini gives a much better answer, listing additional flaws with the question (identifying social desirability and prestige bias as the underlying motivators…