I have this exact problem with my driver's side door.
It's driving i me nuts!
It first happened only when I played songs with heavy bass, but I found it to be buzzing continuously today.
I can't be bothered to take it to the dealer just because of this, so I'll put up with it until my 10,000km service is due.