This is a pretty interesting idea to be honest, I've seen it in a few games, the other thing we could do too is auto-kick players on the end screen before mapchange if they're still AFK... Hm...
The problem with that solution is that even tho the player isn't playing because he's in spectator mode, he's still filling a slot on the server which prevents players who actually wants to play to join the server.