Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design
Hongyang Du, Lan Yan, Christian Flores, Asim Kadav
arXiv:2609.22086v1Today’s paper is about making AI design agents improve from real user traffic without retraining their weights. Graphic design is a long-horizon task: an agent has to open professional software, use hundreds of tools, and produce editable artifacts, but there is no clean automatic answer key for whether a design is good. The authors tackle that by giving a frozen frontier model an external procedural memory written in natural language. When the agent repeatedly encounters a subtask, it can add a new skill; when a stored procedure succeeds or fails, it can revise that procedure and keep only changes that improve failures without harming past successes. Over five rounds on more than 1,400 real briefs, the skill library grew from 76 to 139 procedures and dramatically improved execution success and design quality. Why this matters is simple: it shows a practical path for continual learning in messy, real-world environments where human feedback is noisy and labels are unavailable.
Also spotted that day
Previous daily papers