Try rinsing in hot water soon after your little one finishes a bottle. I have one nipple that was like that after going through the dishwasher. I know it was the one bottle that I didn't rinse right away. Dr. Browns makes little nipple brushes that get all the way to the tip.
Re: Washing bottles