See, it’s not just American Idol that’s having a problem keeping judges around.

America’s Got Talent judge Sharon Osbourne is quitting the NBC show and won’t return next summer. She broke the news with a cryptic tweet on Tuesday: “My darling @HowardStern, money is not the reason I’m not returning to @nbcagt, it’s because…”

Let the speculation begin if Osbourne is quitting because of the addition of Howard Stern or if she simply wants to spend more time with her family in Los Angeles. This is the first season the show has been based in New York, thanks to execs accommodating Stern’s schedule.

On top of that, the NY Post notes that Stern announced on his radio show Monday that he’s on the bubble about returning next season as well. Ratings are down 15 percent compared to last year, despite their high-priced acquisition.