Knit .Rmd file to Word would generate an additional folder automatically

That makes more sense. What version of RStudio are you running?

This might be related: What is the difference between running chunk and knitting it?