For the past few years, affordability has been what’s stopped a lot of buyers in their tracks. Maybe it stopped you, too.