Talk to your OB, but everything I have read says to leave it alone as it can cause preterm labor. I have been producing colostrum (it's yellowish) since about 28 weeks and I just leave it. It doesn't bother me at all, just sometimes leaks out a little. Get yourself some of the nipple pads to wear if you leak a lot.
I'd say leave it, though I'm always tempted to get it out... And definitely invest in some shields. I love it when my boobs leak onto my arms while I'm sleeping and it dried into my arm hair... Not itchy and annoying at all (note the sarcasm). I FINALLY got my comfy Nursing Bras so now I can actually sleep in one and not get icky on my arms.
I'm tempted to squeeze it out too. But apparently it causes preterm labor so I stopped. I've noticed it since 29 weeks but it could have been there long before
Re: producing colostrum