Not really. It's a working/not working type of thing.
If it's affecting your contacts then you will start to get sound drop-outs at lower volumes and then, all of a sudden, you will get output from your speakers when whatever you're listening to gets louder. If you don't clean the contacts then eventually you will get no output at all.