I'm pretty sure color isn't going to work for screen-readers.

I remember attending a con-panel on screenreaders and other assistive technology, and the presenter said she couldn't follow Homestuck fanfic because apparently the characters are color-coded to identify them; her screen reader ignored the colors.