manmal 21 hours ago

What kind of guardrails did you give the agent? Like following SOLID, linting, 100% code coverage, templates, architectural documents before implementing, architectural rules, DRY cleanup cycles, code review guidelines (incl strict rules around consistency), review by another LLM etc?

1
breckenedge 19 hours ago

Not the OP, but in my experience LLMs are still not quite there on guardrails. They might be for 25-50% of sessions, but it’ll vary wildly.

manmal 15 hours ago

Depends on the LLM, recent Gemini models are quite good in this regard.