Glass is mentioned in mishnayos (especially seder taharos) and I have no reason to assume it was colored.
Ayin Google and Wikipedia. They had glass in the days of Chazal but it was opaque, not clear. Clear glass was developed in the 9th century and on, and even then it wasn’t the standard in windows until the last 200 years; really until 1902.