Emperor Julian and education

I read that Julian perceived the condition of the empire to be a primary problem of his reign, a major cause of which was education, hence he had a strong policy on education as he believed that education would play a significant role in the rise of paganism and the decline of Christianity. However, would education not only affect the young aristocrats? They maybe influential secular/religious rulers in the future, but only affects a minority in the short term.