Some providers, however, allow you to withdraw your money before the term expires, with no penalty. Keep in mind that rates may be a little lower for these no-penalty CDs.