Sorry for the late reply.
What exactly is the resolution of your video and is it h264 or h265 please?
Does it happen to all videos you have?
You may want to try sideload the video in Quest and see if it stutters when playing in SKYBOX.
If the video playback is smooth, then one possible reason is that your bandwidth is not enough to support the playback.