"A lot of the architecture that supported discrimination against people is still very much there," said Phil Corcoran