Automatic pull request labels and release comments

On the sidebar, under Notifications, you will be able to toggle your subscription to the thread.

You can also now manage notification settings at the individual issue or pull request level. This lets you manually subscribe to any issue without commenting, or unsubscribe from issues no longer relevant to your interests:

See the blog post, "Mention @somebody. They're notified." for details.

The best solution I've been able to come up with is to create a new status on the same context as successful. This way I can remove the build URL from the status checks and the PRs don't show up as failing (as they were in my case).

To do this I iterated through all the most recent SHAs of my Pull Requests and made the following API call using curl:

curl --user "username" --data @- https://api.github.com/repos/:owner/:repo/commits/:sha
{
  "state": "success",
  "description": "The build succeeded!",
  "context": "default"
}

It doesn't completely erase the build history (so it can still be found using the API), but on the pull request pages everything looks like business as usual.