⏰In a nutshell,
Please move to [Settings tab > Advanced > 'Today's Panel'] and disable the feature.
⏰Keep this in mind
Please note that turning off automatic transfer to 'Today’s Panel' after dismissing the alarm is only offered to Alarmy Premium subscribers.