Sefer Ma’agalei Tzedek writes that when one stops learning Torah, he is immediately beset by ta’avos. The pasuk can be read as saying that when one travels away from “Sinai” – i.e., from Torah study – he immediately travels to “Kivros Hataavah”, meaning that he falls prey to his desires.
He writes that one must always keep in mind that he should never listen to his yeitzer hara when it tries to draw him away from Torah.