It makes no difference to the Tour - it will record that you did the stage inside the 50 hour window.
The app may not show the workout as green, though, if you don’t move it, but will show it as a completed workout on the local day you did it.
Apparently this is important to some people.