When obtained, it starts with no power, But it gains energy from each mob you hit it with. Once it has power and you right-click, it'll cause an explosion and resets the power to zero. The size of the explosion depends on it's power level.
There is a drawback though. Every once in a while, the creeper shard must drain energy to keep working and in doing so poisons the player for about 5 seconds.