What would cause audio to stutter on a computer, when the application producing the sound is not visible?

It sounds like (sorry for the pun) that the application needs to be in the foreground (and get top priority from the OS/application) for the sound to be handled correctly. Background applications (all of the applications not on "top") are often given a lower priority by Windows or the application so the foreground applications look snappier.