in 3.4.4 showing only Default database even though multiple databases are existing.

Linux Machine OS Version 7.5
Multiple R Versions on same server

  1. 3.3.1
  2. 3.4.4

When executed the below command in R Command line getting only "Dafault" database but multiple databases are residing in Spark.

library(sparklyr)
sc = spark_connect(master = "yarn-client",config= list("sparklyr.shell.executor-memory"= "2g","sparklyr.shell.driver-memory"="2g"),version="2.2.0")
src_databases(sc)
[1] "default"

The same command is working with R version 3.3.1 in the same server where 3.4.4 is there.

Could you please guide me on the issue? what could have missed in the latest R version 3.4.4

Thanks,
Vidya Sagar

Could you please share the versions of sparklyr installed by running the following command over each R session?

packageVersion("sparklyr")

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.