Could it be 'A Spell for Chameleon' by Piers Anthony? It's part of the Xanth series and has a lot of magical elements. There's a mirror involved too but it's kinda a long shot since that's more of a magical realm series than alternate dimension.