arthur with glasses was a mood. wore em since i was a kid and this episode was like seeing myself on tv. thought the animals angle was fun, never questioned why animals would need glasses as a kid lol

Could it be 'The Puzzle Place'? They didn't go through a mirror but there were puppets and it was kinda magical in its own way.