It does produce 'sound' ... a compression wave traveling through the air. But your ears don't hear a sound that's vibrating less than 20 or 30 times every second. If you could swing your pendulum that fast, you could hear the sound of its vibrations pushing the air around.
