https://ianbicking.org/blog
2 posts
Tech 50% · Writing 50%
Subscribe via RSS
I was talking with someone about learning and memory, and they reflected (with some disappointment) that it’s the negative things we remember best. I’ve been struggling with something similar with LLM memories, and thinking about the parallels gave me some insight into both: When pulling memories out of …
Generating poetry was among the first popular parlor tricks for an LLM. Poetry is appealing because it has the form of something carefully constructed, and yet plays into the LLM’s abilities to join disparate elements: words, expression, rhyme, rhythm. Attending to each simultaneously challenges a human to create a foundation for the poem. To create meaning and express that meaning through each element. The LLM has the easier task of simply finding a path of words. “Write a short humorous poem…