With the cost of concerts, sports games and restaurants far outpacing inflation, more people are staying home.