2 hours ago · Tech · hide

If you are a researcher who wants to study how people work with AIs to build software, what is your strategy for experimental design? It occurs to me that Bram could serve as a useful research instrument in various ways. Using a guided workflow Bram enforces a disciplined way of defining and executing subtasks (the “Worklist”). The most consistent feedback about Bram, so far, has been some version of: “I feel like I’m in control.” One possible A/B experiment: for a given assignment, group A defines and executes subtasks in a free-form way and group B uses the Bram workflow. How do participants feel about their control over the process? Working in a repo Bram manages work in a git repository and structures the work so that it flows into the repo in a clean and orderly way. Another A/B experiment: group A clones an unmanaged repo and performs git ceremonies in free-form dialog with agents, group B clones the same repo and uses Bram to direct git ceremonies. What do the resulting repos…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town