I found the following post.
The color of menu bar seems to be able to be changed in qss files in stylesheets folder in previous Rstudio version. But these qss files were removed in the new version. I followed that post and maybe someone could give the soluation.