by theanonymousone 9 hours ago
What is meant by a "loop" here? Just repeating the same prompt until you get the desired result? Are subsequent repetitions too close to each other?
Loop "engineering" has now become a thing now apparently (a la prompt "engineering") https://github.com/topics/loop-engineering
> Just repeating the same prompt until you get the desired result?
Not necessarily the desired result, but until it's 'done', where the LLM itself is the judge on if the is the case according to the given criteria (often just an updated todo-list). One of those extremely simple 'harnesses' (if you can even call it that) was even named the 'Ralph Wiggum Loop' [1] to allude to the braindead-but-persistent tokenmaxxing it results in.
What I have been doing seems a bit different to what's described, but I always make sure to define how to know the task is done so the agent doesn't quit early. Usually this means telling it to to run the tests and type checks to ensure it runs without errors.
Otherwise they often do a first pass looks good enough but it doesn't actually work.
[dead]