Perry vows to fight allegations against him