Rendered at 21:50:33 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
juanpflores 3 hours ago [-]
Hey there!
Coderabbit DX staff here. We have a new interface we are exploring for code review called change stack. Would love to hear your feedback on it and learn of the issues you mentioned above. If you have a PR we could take a look at I can bring this to the tea,
taurath 16 hours ago [-]
I’m considering a set of skills that I can apply common lenses to PRs (metrics, error handling, testability + tests, architecture, security), and fetch the code and pr details via the GitHub CLI or an MCP. This seems like it might get absurdly expensive, but maybe w the right tuning it’ll be possible to run most of them on smaller models. Each would let me zoom in on its area and help me through the process of reviewing.
The problem is with full on misses that I’d be able to catch by going line by line. The more static analysis and style enforcement the better - I’m still not sure whether it will come out as a benefit, esp when you consider cost of tokens. AI often creates its own extra work alongside the benefits, and it’s a bit like nicotine in that it works for a minute but then you’ll need to keep applying it to even return to baseline.
ryanchants 8 hours ago [-]
That's what I do[0]. I run a gauntlet of judges against the PR, each with a strict lane to check.
The problem is with full on misses that I’d be able to catch by going line by line. The more static analysis and style enforcement the better - I’m still not sure whether it will come out as a benefit, esp when you consider cost of tokens. AI often creates its own extra work alongside the benefits, and it’s a bit like nicotine in that it works for a minute but then you’ll need to keep applying it to even return to baseline.
0: https://github.com/jacquardlabs/gauntlet
Sometimes I'll prompt again to scrutinize further.