Serkin was born in Bohemia as the fifth child in a family of eight children. He studied in Vienna piano with Richard Robert, and composition with Joseph Marx and Arnold Schoenberg. He married the daughter of the violinist Adolf Busch and became his permanent companion.
Serkin was also active as a composer. He composed a String Quartet.