Why do computers use binary?
Short answer
Electronic circuits can reliably represent two states such as a higher or lower voltage, making binary convenient.
How it works
Decimal numbers and text are also represented internally as combinations of bits. Binary is a foundation, not the whole picture.
Key point
The practical point is this: Binary is a foundation, not the whole picture.