Do you mean a data frame or do you actually mean a matrix?
If you do mean a data frame, are the columns the same in the different csv files?
It will help if you provide a reproducible example.