suuuuure they did. And the ATM shortly after.
Nope, it took until the 20th century for the ATM. Checks did not become popular until the 1500s (Dutch banking made them popular), but the Romans knew what they were.
Oh yeah, so did the Persians (called Sakks).