You need to make a decision that works for you and your husband. You're still young and may change your mind later, but if neither of you want kids now, why WOULD you? Don't worry about others opinions (including mine) because that's all they are.
DH and I came to this decision several years ago, and are now married 20 years without kiddos. Our reasons made sense to us, and eventually, people do stop pestering! We've managed to make friends with several couples who, for whatever reason, also don't have children. It IS a choice. Now, if only I could talk him into another yorkie
Good luck to you whatever you decide to do!