Heck yes you sit down with him and figure it out! I mentioned that in the article. See below...

"With the no-show husband situation, you figure out why he was late and implement measures that will ensure it doesn’t happen again."

This isn't about becoming a doormat. It's about responding from presence, not resisting.