49 days ago · 11 min read2160 words · Tech · hide · Fediverse post

Since experimenting with Codex, and now Muse, I have been exploring an interaction pattern for use alongside chat-based systems which I think makes sense to call Generative Control Surfaces (based on Muse’s suggestion). Codex offers the following short definition: Generative control surfaces are an interaction design pattern in which an AI system creates a task-specific graphical interface during ongoing work, connects it to retained task state, and adapts it as the work changes. I set up a Github repository with a more lengthy conceptual overview, and two example implementations of a skill, one for Codex (written by Codex), one for Muse (written by Muse). Generative Control Surfaces repository & overview Codex Control Surface Skill Muse Control Surface Skill I’m going to just pull in the bulk of the readme.md file contents from the repo. I used Astra 6 Medium to write it after some failed attempts with other models, and it hit the target well here, I thought: Generative Control…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town