Why do silencers make bullets weaker and not stronger?

Sound is energy and the bullet is using energy to leave it's chamber, so why does severely decreasing the sound not give the bullet more energy/ speed instead of decreasing it's speed/ energy?