> According to the Foreign Service Institute, Mandarin and Cantonese (you didn't specify what kind of Chinese) are among the hardest languages to learn for a native English speaker.

But their criteria is the study time required to reach proficiency in both spoken and written language. Arguably, Chinese and Japanese wouldn't take so long to learn if they had simpler writing systems.