"The increase in the payroll tax has undoubtedly dampened consumers' spirits and it may take a while for confidence to rebound and consumers to recover from their initial paycheck shock," Lynn Franco, director of economic indicators at The Conference Board, said in a statement.