Notice how the Yevonim were disgracing Kavod HaAdam. They played their Olympic games undressed like animals (and their gods were undressed statues). And originally, Yefes, their forefather had helped Shem cover the shame of Noach. Why did they fall? Shouldn’t Yavan be forever an aid to Shem, like their forefather, Yefes, who helped Shem? We can suggest that the name Yefes means making an impression (like the Chovos Halvavos says: לְ הִ תְ יַ יפ וֹת לִ פְ נֵ י בְ נֵ י אָ דָ ם שער יחוד המעשה), and Noach said: יַפְתְ אֱלֹקִ ים לְיֶפֶת נח ט כז Hashem should make Yefes famous. When a person gets carried away with getting recognition for his good deeds, he can lose everything, since he isn’t serving Hashem; he’s just impressing people.
He is actually a Baal Avoda Zara who worships people opinion. (Chovos Halvavos)