potential new apt next to construction sites

evildove

We're considering a new apartment that has 2 building construction sites right next to it. One is a 280 unit luxury building that's about completed groundwork and we don't know much about the other. 
Is this a safe situation for a fetus and/or newborn? Especially if we like to have our windows open for some fresh air every now and then? My doctor said it should be fine and his only concern is lead dust and that we should test for that but is there any other type of dust that could be harmful to the respiratory system?  Thanks!