The first genetalgeneral programmable computer ENIAC was wired up to do its math in base 10 to make the debugging and human interface simpler. If its successor in alternate history ENIAC 2 stayed with that premise and subsequent generations never changed - computers would be base 10 at the machine language level.
In real history UNIVAC followed and went with the more natural binary.