What happens if you pick off skin tags? Third, skin tags can, and do, bleed if you try removing them at home. With your skin opened up, you put yourself at risk for infection, making the original skin tag a problem you wish you still had.