I guess you have selected Shuffle Answers in each quiz question properties. That will only shuffle answers within a question and not randomize the set of questions. To randomize questions, you need to create a question pool, Quiz > Random Question Slide.
Sreekanth