It looks like Khloe Kardashian will be taking time away from her own reality TV family to host the X Factor but apparently the E! network isn't too pleased about losing a Kardashian. According to reports, E! is proving to be somewhat of an obstacle in closing the X Factor/Khloe deal. "Keeping Up with the Kardashians" has an exclusive contract that's putting a giant X through the possibility of Khloe hosting the X Factor.