Its best not to use needle nose priors to grap the needle jet from the bottom. You could cause damage. Instead, with the needle and diaphram removed, just lightly tap with a punch, on the top of the needle jet. It will come right out. Its just the friction of the O-ring holding it.
Since you're in PEI, you won't be able to order from McMaster Carr (they don't ship to Canada). If you find your O-rings are bad, send me a PM here on the site, and I will mail you a pair of O-rings, as I have a few spares.