How move / copy 36000 files?

[M_AcostaCH]

Hi community

In a another question Im make something very same to my current questions today .

Move files in a specific folder with df list

Hi community I'm download 20.000 files .png with web scraping, and put in order to specific folder name. Each folder has 1 or 2 .png files. For example folder G 1, contain two picture, for sed and pod. (see the link) basic <- data.frame(ACCESION=c('G 1','G 7A', 'G35015', 'G40897','G27573'), FOLDER= c( 'P_vulgaris', 'P_vulgaris','P_dumosus', 'P_albescens', 'P_lunatus')) In basic of FOLDER I'm want create this folder that contain 2 other folder, for sed and pod but depend of FOLDER name. For example the FOLDER P_vulgaris is necesary create 2 others folders, sed and pod. In sed folder I'm want put the sed picture of G 1 and pod folder put the pod picture. …

Maybe was not the best solution but in this case worked well.

Now, I'm need move or copy 36.000 files to other order directory.

Im get the to path, source and destination. But when Im try to run my Rstudio collapse

# run well wit this example
df = data.frame(                                            
  source = c('\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed/G    1.jpg',
             '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed/G    2.jpg',
             '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed/G    3.jpg',
             '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed/G    4.jpg',
             '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed/G    5.jpg'),
  destination = c('\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\G1\\G1 seed.jpg',
                  '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\G2\\G2 seed.jpg',
                  '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\G3\\G3 seed.jpg',
                  '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\G4\\G4 seed.jpg',
                  '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\G5\\G5 seed.jpg'))

file.copy(from = df$source, to = df$destination)

url <- "https://docs.google.com/spreadsheets/d/1qoHxBRfchDanYc8pvTH8esa6ANL-N-Ja/edit#gid=430580483/export?format=xlsx"

download.file(url, "acn.xlsx")

Im get the all the path, because create the destination folders.

# Im try with this other form but the path source are not correct

source_dir <- '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR ODISEA\\20230227\\bean\\seed\\'
dest_dir <- '\\\\ALLIANCEDFS.ALLIANCE.CGIAR.ORG\\CL07_GRPhistoric\\GRP_OPERATION\\DOCUMENTATION\\ODISEA GENESYS\\SERVIDOR GENESYS\\20230303\\acn\\'

# loop over the file numbers and copy each file
for (i in 1:5) {
  source_file <- paste0(source_dir,'G', i ,'.jpg')
  dest_file <- paste0(dest_dir, 'G', i, '\\G', i, ' seed.jpg')
  file.copy(from = source_file, to = dest_file)
}

Any suggest, or link or other way is very useful.

[williaml]

You could use list.files() to get all the file names, then move them to the other folder. It would probably be faster to use purrr::map() than to use a for loop. But even so, that many files would take a long time.

Example:

library(glue)

# create folders and files -----------
dir.create("folder_a")
purrr::map(1:100, ~file.create(glue("folder_a/{.x}.csv"))) # 100 test files

# list of files -----------
files_to_move <- list.files("folder_a")
files_to_move_locations <- fs::dir_ls("folder_a")

# create new folder -------------
dir.create("folder_b")

# move to new folder -----------
purrr::map2(files_to_move_locations, files_to_move,  ~fs::file_move(.x, glue("folder_b/{.y}")))

It could be better/faster to use Shell/Powershell to do it.

Move files in the Linux terminal | Opensource.com

Whatever you do would probably take a long time.