Asked why they plan to push back their retirement plans, 44 percent of respondents said they were concerned about inflation, 34 percent said they were worried about a recession, the survey found.