I'm not sure which "Voice Assistant" you have turned off, but the reading out loud after certain distance or time is controlled in Samsung Health app on the watch. In the widget where you start an activity, touch the 3 horizontal dots. Scroll down to guide frequency and turn it off. Do this for each activity.
The only thing that works is to turn off the automatic workout detection and not using it at all.
Good job Samsung. Nice feature.