Sounds like a classic design fail, mate. I'd screw in a small rubber pad on each end of the holder, to add some resistance. If you're not into DIY, there's always duct tape – fixes everything, right? Otherwise, hit the store and grab yourself a holder that doesn't double as …