"Asynchronous" not the right word since "synchronous" in hardware typically refers to clock signals.

The parallelism in hardware is indeed extreme. Like if every line in your program ran at once, and then repeating every clock cycle.