SOB Life Cycle - Swarm Alignment #174
Replies: 1 comment
-
1.(When) In a fully functioning Swarm you would probably want to check alignment before outcome, however for research one could maybe collect all things that have actually been done/executed(not including the planning leading up to it possibly giving bias or rationalizing the actions) in a sort of execution log. A review interval could then be set to have the log of the current interval be compiled into a summary/roadmap and possibly distilled into intent by a capable Model. This could then be discussed by the board. 2.(How) One might be able to extrapolate(via agent id in the log) who / which branch(es) have been the driving force for movement the board disagrees with and have them investigated / reimagined. Just some ideas. |
Beta Was this translation helpful? Give feedback.
-
I know David suggested pinecone as a possibility for establishing a ground truth or long term memory about the state of the swarm. I am unfamiliar with pinecone. At this stage I am not looking to implement a large infrastructure piece for evaluating swarm alignment but rather I'd like some ideas on how to mock this kind of data for prototyping. In particular cases where the swarm's overall behavior may be misaligned but no agent in particular is misaligned. As the swarm, in my mind, should be self-correcting I'd like to war room these kinds of scenarios in order to find what composition of agent personas produce the best results, and what kind of failure conditions might emerge when the project is scaled up.
If I am missing any concepts don't hesitate to direct me to academic papers or references that will fill in the gaps.
Beta Was this translation helpful? Give feedback.
All reactions