ChatGPT keeps using the word "collapse" when I talk to it. Why is that? Someone even said it to me at work the other day and I noticed, and I began to wonder if that was from being exposed to so much "collapsing" being fed to us from the models. Why are all concepts seemingly being needed to collapse into themselves? My search history alone in ChatGPT for the word "collapse" returned 51 hits since mid-2023. I'm not that heavy of a user, but damned if it doesn't keep saying it. The answer to this seems to be a fairly simple one: the way that these models are trained rewarded this word. It must've popped up in a response and the raters (contractors and/or internal folk whose job is to sit and decide if an output is good or not) saw this word and thought "wowie, that word fucking hits in this sentence" and clicked on the button that says "good work, Chat". Words like "collapse" are words that have high valence, meaning it's highly attractive (or the opposite) and leaves you feeling like…
No comments yet. Log in to reply on the Fediverse. Comments will appear here.