ChatGPT knows everything about its users. It will not be a good steward of that power.

Link: ChatGPT Is Building Detailed Psychological Profiles of Its Users, by Maggie Harrison Dupré in FuturismIt probably shouldn’t be a surprise that chatbots like ChatGPT are profiling their users. Still, there are some surprising numbers here:“A staggering 96 percent of memories were created unilaterally by the chatbot, according to the study, meaning that the users had little overt control over the data points that ChatGPT logged as their interactions wore on. Stored memories were also deeply revealing about users. About 28 percent of the memories examined contained personal data as defined by Europe’s strict General Data Protection Regulation standards, and 52 percent contained rich “psychological insights” about users.”I think back to Gina Chua and Adiel Kaplan’s three-layer cake analogy for the AI stack. In their analysis, the consumption layer profiles the user; this new report makes clear how deep that profiling goes.As I said in my commentary then:“Profile data is accumulated,…