The shuffle button does it’s thing every time you activate it. I believe, anecdotally, that it uses whatever song is playing or selected as a seed to build the random queue.

Try this, select a song and press Shuffle. When it gets to a song you don’t want to hear, skip to a song you want to hear and toggle Shuffle off and on.