hmm sounds familiar, arent you talking about that show 'Takeshi's Castle'? lots of weird and wacky challenges, though not exactly in a giant house... that was more like an outdoor setting. might not be what ur looking for but defo had a cult following