Back in 2004, Kagan had a brief affair with Rush Limbaugh, a radio talk show host. But this relationship didn't last for more than 2 years, and they called it off in 2006.