Ashlee Simpson and Pete Wentz held hands leaving a restaurant in LA Wednesday night.