Despite potential penalties for tapping into retirement savings before reaching 59 and a half, many workers report doing that during financial difficulty. A new survey released this month from the Transamerica Center for Retirement Studies shows that 37% of workers report taking a loan, early withdrawal, or hardship withdrawal from their IRA, 401(k), or similar retirement account.