Spark Web UI Access on RStudio Cloud

sparklyr has a method to start a web UI for Spark like this

spark_web(sc) where sc is an active spark connection object

that starts a browser with this URL:
http://localhost:4040/jobs/

Following the thread for getting access to h2o's Flow web app,
(Launching localhost web apps in Rstudio cloud)

I formed this URL:
https://username.rstudio.cloud/6bf1c53c9663498c8f7c6acbe33febaf//p/4040/jobs/

When I try to access that I get a "Please Wait" message with a scrolling "bar chart" progress indicator that never resolves to any actual content.

Ideas of what to try next?

I did the following:

> sc <- spark_connect(master = "local")
* Using Spark: 2.1.0
> rstudioapi::translateLocalUrl("https://localhost:4040/jobs/", TRUE)
[1] "https://jspiewak.rstudio.cloud/39b15e63420e4bc4a2c96f9d633fa428/p/7835effc/jobs/"

Bingo, that worked. I had 2 slashes before the p. (//p). The translation helped me from fat fingering the URL construction by hand. Thanks for showing me that.

Phil

1 Like

Could you please mark the reply as being the solution?

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.