You can download all student submissions for an assignment in bulk.

All submissions are downloaded as a single zip file, which you can then use to grade submissions offline on your computer.

If you allow more than one submission attempt and a student resubmitted an assignment, the zip file will only contain the most recent submission. You can access the previous submission attempts via SpeedGrader.