If the audio input is NOT connected to the source when the noise occurs:
There may be signals from the environment which might be picked up by the speaker and therefore produce the noise.
If the audio input is ALREADY connected to the source when the noise occurs:
There may be dust or oxidized metal on the connection.
There may be dust or oxidized metal on the volume control parts inside the speaker.