Yes, that was a bug last week. If you joined a game and it was cancelled, the game wouldn't clear your alerts for it. Since you can't ever view a cancelled game again, you'd be stuck with a perma-annoying-badge. That bug is been fixed for a while and I just reset your alerts in the database, so you should be all set.
Let me know if that happens again.