Acting IRS Commissioner Melanie Krause said Wednesday that the agency will take previously fired probationary employees off paid administrative leave.