Check all places with `check_mode: no` for side effects (#8573)

and fix the one with side effect.

Also removes `notify` from this task as the task has `changed_when: false`
and notify is not going to fire.