It depends on the case, however I come from a background where product deliverables come first and on a short deadline. Refactoring requires time that many developers (and the teammates that have to review their changes) can't afford. If refactoring will greatly improve the usability of the code in the future then it's worth it, but must be done with extreme attention to detail as not to break anything.