Patchies - Embodied Agents

User can create their own agents and talk to them.

Agents with memories.

"Agent" object that can communicate via messages?

Sidebar should have Chat/Agents tab:

  • Chat. Talk about the patch. Can query patch information.
  • Customizable prompts. Let users define prompts.
  • Persistent memories store that are editable.
  • Edit patch data wholesale.
  • Edit code with diff / approval/ code rollback.
  • Embodied. Place agent on the board.
    • It can tool-call to move to specific objects e.g. move_to_object(objectId) or highlight object highlight_object(objectId) 


  • chat based interface
  • customizable prompts / build your own agent
  • agent autonomously perform tasks on the patcher, get approval and input from the user
    • TODO lists, Code Approval, Tool Call
  • builds on top of serializable patcher and headless patching, and expose operations as LLM tool calls
  • ref: talk to the hand. youtube sigchi, sigchi program
  • Create AI agents that talk to one another
    • reference: MAGI from Evangelion - https://github.com/TomaszRewak/MAGI
    • make aliens that talk to one another.
    • make a sci-fi game that you have to decode alien's language. they will talk in visual and audio.
  • Call AI tools

#patchies

Back to Home