Doing that would cripple mathematics and sciences.
Imagine a world where accountants and engineers do arithmetic, and mathematician do theoretical work on geometry and the like. But something keeps the two groups from talking to each other in a systematic way.
No calculus for engineers. No statistics for epidemiologists. No trigonometry for surveyors.