Depending on your birth year, the IRS requires you to start withdrawing from your retirement accounts once you are 73 or 75— whether you need the money or not. Those withdrawals, called required minimum distributions (RMDs), count as taxable income. And depending on how much you’re required to take, they can affect your tax bracket, your Social Security taxes, and even your Medicare premiums.