Anyone would be able to repeatedly challenge someone while lowering their score if they keep declining.