With the Nationals leading the New York Mets 25-1 heading into the ninth inning, Kelley was brought in to close out the game. The right-hander allowed three runs off four hits - including a two-run home run. After serving up the homer, Kelley threw his glove to the mound and stared into the Nationals dugout.
Kelley was designated for assignment Wednesday after Rizzo considered his actions to be "selfish."
"You're either in, or you're in the way," Rizzo said, according to Mark Zuckerman of MASN. "It was something I didn't expect, but it was something I couldn't ignore."
Kelley insisted following the game that his frustration was with the umpire and not with the team.
"No, you can ask everybody in the bullpen. When (Wander) Suero’s pitch count got up, I said, 'I've probably got the ninth.' I figured I was the freshest reliever and I was going to throw the ninth," Kelley said, according to Chelsea Janes of the Washington Post.
"Like I said, for me, I'm not justifying it. I should not have thrown my glove and acted like a baby out there. But at the same time, I'm acting like it's one to one for me. I'm giving it everything I've got."
Kelley added that the second-base umpire told him he needed to come set or he would be called for a balk, while the home-plate umpire was urging him to hurry up.
Manager Dave Martinez called Kelley throwing his glove "disrespectful to the organization," according to Jamal Collier of MLB.com.
Issues in the Nationals clubhouse have been a cause for concern in recent weeks with a report calling the clubhouse "a mess." Outfielder Adam Eaton tried to clear up any rumors on Tuesday, calling those reports "a load of crap."
Kelley owns a 3.34 ERA, 0.96 WHIP, and 32 strikeouts in 32 1/3 innings this season. He's a free agent at the end of the season.