If you're playing with a group of friends your only option is to either play in "live challenge" mode, or in "team duels", but its not possible to play duels.