Before clicking the download button, select the option to enable captions. This will ensure captions are included in your downloaded video.

Here's a helpful guide: Adding Captions.