There is a big difference between "doesn't want me to" or Doesn't let me".
If he is ASKING you to PLEASE not wear those things, then he is concerned about your appearance and how others might perceive you when you dress that way. (He doesn't want other guys looking up your skirts.)
If his is TELLING you to NOT wear those things, then he is manipulating you. Guys like this start out by telling their girl friends not to do small things. Like "don't wear that skirt, I don't like it". As time goes on, they add more things to the "don't do it" list until you have a father instead of a boyfriend. Guys like this will also do everything they can to keep you away from your friends. If you stay with them long enough, they will even keep you away from your family. They will make sure they have total control of every aspect of your life.
Anytime you start a sentence with "he doesn't let me", then you are in a bad relationship. Relationships must be a compromise and should never be one partner telling the other one things they can't do.