The lifestyle icon was "so pissed" to turn down the 2005 opportunity, she told Jimmy Fallon on The Tonight Show.