Okay so there's this old show I used to watch when I was a wee one. It had these really weird puppets, kinda spooky but it was a kids’ show. I think the main one was a witch or some sort. It's like 'Sooty and Sweep' level of old. This …

It sounds like you're describing 'Word Travels' which had short episodes focused on different languages. If I recall correctly, it wasn't a long-running series but it did have quite a bit of charm and educational value. Featured a live host and animated characters if memory serves me right.