There actually are a surprising amount of older people that read the Potters. The publishers even published a set with more "mature" covers to appeal to an older audience.
I remember going on the public transit to classes, and seeing the people, all on the subway reading the books; they weren't kids.