Add AI issue summary

[mnordine]

Not a language issue, but I noticed in the sdk repo, there's an AI that summarizes the issue. I find it works pretty well. Perhaps it could be used here? Or would the issues be too esoteric for it to be effective?

[lrhn]

@devoncarew

[devoncarew]

The triage process - assigning labels - is different here, but the summaries may still provide value. This would be straightforward to hook up if so desired. It looks like the language repo gets ~50 issues filed a month, so some automation here could help lower the cost of triage.

@dart-lang/language-team for thoughts

[jakemac53]

Seems fine to try out at least? We can always remove it if we decide it has negative value.

[leafpetersen]

I'm open to experimenting, but I'm pretty skeptical. Is there a way to see what will be generated before we start spamming the issue tracker? Note that the vast majority of issues on the first page of the issue (just to take a sample) were filed by the language team. That doesn't mean that a summary couldn't be useful, but it would mean the bar for usefulness is pretty high.

[devoncarew]

The summaries have generally been useful; you can see samples here: https://github.com/dart-lang/sdk/issues?q=is%3Aissue+is%3Aopen+label%3Atriage-automation. For the sdk issue tracker we do not summarize if the issue has already been triaged; there, that means having an area- label. That wouldn't apply here, so most issues would end up getting summaries.

As @jakemac53 mentioned, I think its low cost to turn on, decide the summaries are spam, and improve things or disable the bot.

[leafpetersen]

I'm not very impressed with the summaries linked, TBH. Are people really getting something out of them? The one linked in the first comment above adds nothing I didn't get out of the first few lines of the original comment, and I'd say pretty much the same for most of the rest of the ones linked above.

[mraleph]

I will go on record and say that these summaries are useless noise which I simply learned to filter out. I never look at them now. I would honestly prefer we stopped producing them on SDK repo instead of adding them to more repos.

[davidmorgan]

I also seem to have trained myself to skip AI-generated summaries generally, so it's -1 from me.

[natebosch]

I think we all agree that the AI summary of an issue file by a Dart language team member isn't going to add value. We're mixed on whether a summary of a long issue discussion is likely to add value. Maybe we can look at new modes for this, for instance we could add an ai-summary tag which triggers a new comment with a summary of all comments so far.