>> It's the sort of dream that I'd want to turn into a story, only any sort of "magic school" will look like a rip off of Harry Potter. (Yes I know the trope existed before HP, but still.) <<

Go for it. A magic school with a competent teacher looks nothing like Harry Potter or any of the others I've seen in mainstream books. They're all horrible. Yours sounds much better.