Before you jam a potato into that broken bulb, take a look at the Bulb Base-Out tool — you insert it in the broken bulb base, twist the base of the tool, and then twist the bulb out. I never had any luck with that old potato anyways.
The Bulb Base-Out’s magic is in the fingers at the end — they expand when you twist the base so they can grab the inside of the broken light bulb. Strategic Insight makes the tool from non-conductive plastic so the danger from shock is minimized.
You can get the Bulb Base-Out directly from Strategic Insight for $5 — any tool at this price is worth giving a shot.
Bulb Base-Out [Strategic Insight]