In some of my stories, the most irritating thing I face is other people adding characters that are not even supposed to be in there in the first place, so it'd be convenient if they added a feature where the story creator can remove unwanted characters added by other people. Of course, an "are you sure?" thingy should pop up when you click the button, in case you accidentally pushed it or have second thoughts.