56% merge rate on 316 cold OSS PRs in a week

(github.com)

3 points | by kimjune01 1 hour ago

2 comments

  • kimjune01 1 hour ago
    I've been running a public experiment on how far I can take agentic coding harnesses. When I ran out of my own stuff to work on, I looked to open source.

    So far, I got the harness to create 368 PRs, 110 of which were resolved. Of those, I got a 56% merge rate.

    The harness: https://github.com/kimjune01/sweep

    But as soon as I realized what I was doing to maintainers, I worked all night to build the same pipe but backwards for PR review.

    The defense: https://github.com/kimjune01/immune

    Which means: bots on the contributor side, bots on the maintainer side. The surprise? What's left is two humans on either end. I accidentally invented a H2H protocol.

    I'm happy to share what I learned.

  • hieu_dev 1 hour ago
    [flagged]