By David Perel - Executive Vice President/Managing Editor Radar

In Greensboro, N.C. for The X Factor auditions, Simon Cowell got a taste of southern cooking -- but it was his fellow X Factor judges who were steaming. Britney Spears, Demi Lovato and L.A. Reid were left waiting 45 minutes as Simon spontaneously decided to drop in and have breakfast at a diner while on his way to the show.

“One minute Simon was on his way to the Coliseum and auditions were about to start - the next thing security was radioing over that Simon had diverted the driver and asked to go to a local diner," a source told Breaking Celebrity News exclusively.

The show has had its fill of drama, with Spears walking off the set several times and Simon clashing with his new judges. But on Tuesday, his impromptu breakfast at Jake’s Diner left everyone at the studio furious, especially Reid.

One source on the set was heard telling producers, “Simon’s at a diner? Is that really what we’re waiting for? I don’t care about grits and cheesecake!”

But Simon does.

And he also cared about mashed potatoes and beans, enjoying his breakfast so much that he took the leftovers with him when the show sent a runner to get him out of the diner.