When the phone is off it’s off. It will not turn on for the alarm. However, have you considered using OFFLINE+
It will cut off all the peripherals (and cuts power on the software & hardware level) but the alarm will still ring. I just tested it & it work like a charm.