Prevent other apps from hijacking iTunes controls

I use iTunes to play all my music, but I also have the Spotify app.

Every time I use Spotify, then use another app, such as Chrome, my keyboard controls stay with Spotify instead of iTunes.

Is there a way I can make my keyboard media keys to control iTunes only?