I know from watching friends and family members go through the wedding planning process over the years that couples rarely have the exact same number of close friends and family members in mind for their wedding parties. You can save yourself the headache of trying to come up with a magic number of people to include that makes you both happy by skipping the wedding party altogether.
