How come the heart is associated with love?

Sure when I see a pretty woman my heart may beat faster but it also does that when I'm scared, startled, nervous, anxious and out of breath.