The Radio 1 DJ says he would rather watch the show than appear on it.
Grimmy will not be returning as a judge on the X Factor this year’s series.
“We announced on this show last year that I was going to do X Factor, and maybe now we should say that I’m not going to do X Factor,” he said.
He went on to say it was his decision to quit the show and wasn’t fired.
“We just had a think about it and sat down, and I just thought it’s one of those things that I loved, I did love it, its not a diss to the show, it’s not me storming out of X Factor being like ‘screw you Cheryl’!
“It’s a great show and I loved it. But it’s definitely a once in a lifetime style thing. I just want to watch it on the telly.” he added.
He later joked that his love for curry had led him to leave, because “you can’t have a curry when you’re on it on a Saturday night, because you’re there.”
Asked what he’d say to his replacement, he quipped: “Don’t do it,” before adding: “Just kidding. It is really fun, its a riot. You’ll have a great time.”
Although Grimshaw says he never felt the need to come out, it seems thousands of people apparently didn’t know that the DJ is gay, with viewers flocking to PinkNews throughout last year’s X Factor to ask ‘is Nick Grimshaw gay?’
As thousands tweeted – apparently unable to get an answer to the question – many were directed to this PinkNews article.
However, despite the apparent pique of interest in the host, the reality show received its lowest viewing figures to date during the last series.
In a further blow for Grimmy, it was announced a significant amount of people had stopped listening to his increasingly unpopular radio show.
It’s not known whether Rita Ora or Cheryl will return but it is thought Simon will remain on the panel.
There have been rumours Simon is lining up Louis Tomlinson to have a role on the show when it returns.
Listen to Grimmy’s announcement below: