Buzz notification does not always stop

But unexpectedly it continues to buzz every few seconds until I long-press the button and return to the Clock.

Go to Settings -> apps -> Messages -> Repeat and set it to off and I think that should do it. The idea is it's there to remind you if you miss the first buzz.