I totally understand where you are coming from. I only have one brother, we are 3 years apart. When we were younger we were best friends at times. Now that we are older we are not nearly as close.
We just live two very different lifestyles right now. I just had a baby last January and he is my world. Before I had him I wanted 4 children, hubby wanted 3. I also don't want an odd number. I remember inviting two friends over for a sleepover as a child and someone always felt left out being 3 of us. So we will either just have my son or one more.
