Yes. Skills slow both spell-learning (how fast you advance in a spell) and spell-acquisition (when you can get a spell) down, and vice versa.