You could try with a named vector: Using Named Colors with ggplot2 - John Quensen (john-quensen.com)
Otherwise, your code isn't reproducible as we don't have an example of your dataset.