Styjun

Cut a cake into 3 equal portions with only a knife

Will Proving or Disproving of any of the following have effects on Chemistry in general?

Why is there is no screening for Ovarian Cancer?

What is the need of methods like GET and POST in the HTTP protocol?

Sparse columns, cpu time & filtered indexes

Can Northern Ireland's border issue be solved by repartition?

As an employer, can I compel my employees to vote?

Are there non JavaScript ways to hide HTML source code?

Norwegian refuses EU delay (4.7 hours) compensation because it turned out there was nothing wrong with the aircraft

Where are they calling from?

Why does NASA publish all the results/data it gets?

What is the meaning of word 'crack' in chapter 33 of A Game of Thrones?

An Algorithm Which Schedules Your Life

Is it impolite to ask for halal food when traveling to and in Thailand?

Guitar tuning (EADGBE), "perfect" fourths?

What do you do if you have developments on your paper during the long peer review process?

How does IBM's 53-bit quantum computer compare to classical ones for cryptanalytic tasks?

Do all creatures have souls?

What happens if nobody can form a government in Israel?

Performance for simple code that converts a RGB tuple to hex string

Where Does VDD+0.3V Input Limit Come From on IC chips?

Do the villains know Batman has no superpowers?

Manager encourages me to take day of sick leave instead of PTO, what's in it for him?

Is the mass of paint relevant in rocket design?

How to execute Intellij Spark Code on Databricks Cluster

How can I permanently enable line numbers in IntelliJ?Spark - “sbt package” - “value $ is not a member of StringContext” - Missing Scala plugin?intellij idea with scala error on : import org.apache.spark.SparkContext, SparkConfDeploy doesn't support the nested “bundleArgument” elementError. Object apache is not a member of package orgFailed running activator run after play-slick upgradesbt-eclipse unresolved exception“unresolved dependency” for Spark 2.1.0 on SBTsbt got error when run Spark hello world code?Java Class not Found Exception while doing Spark-submit Scala using sbt

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

1

2

I'm trying to launch my Spark code that i've written in Intellij and run it on Databricks, so I've found that it can be done by "sbt-databricks" plugin.

Here is my build.sbt file :

name := "DatabricksTest"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies ++= Seq("org.apache.spark" %% "spark-core" % "2.4.0" //% "provided"
 ,"org.apache.spark" %% "spark-sql" % "2.4.0" //% "provided",
 )

dbcUsername := "token"//

dbcPassword := "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"// 

dbcApiUrl := "https://westeurope.azuredatabricks.net/api/1.2"//

dbcClusters += "Cluster1"

And here is my plugins.sbt file:

addSbtPlugin("com.databricks" %% "sbt-databricks" % "0.1.5")

When I try to list the clusters using dbcListClusters I have the following error

[trace] Stack trace suppressed: run 'last *:dbcFetchClusters' for the full output.
[error] (*:dbcFetchClusters) org.apache.http.client.HttpResponseException: Bad Request
[error] Total time: 3 s, completed 28 mars 2019 16:18:54

Can you relate to this error ?

Thanks

scala apache-spark intellij-idea sbt azure-databricks

share|improve this question

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

add a comment
 | 

1

2

I'm trying to launch my Spark code that i've written in Intellij and run it on Databricks, so I've found that it can be done by "sbt-databricks" plugin.

Here is my build.sbt file :

name := "DatabricksTest"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies ++= Seq("org.apache.spark" %% "spark-core" % "2.4.0" //% "provided"
 ,"org.apache.spark" %% "spark-sql" % "2.4.0" //% "provided",
 )

dbcUsername := "token"//

dbcPassword := "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"// 

dbcApiUrl := "https://westeurope.azuredatabricks.net/api/1.2"//

dbcClusters += "Cluster1"

And here is my plugins.sbt file:

addSbtPlugin("com.databricks" %% "sbt-databricks" % "0.1.5")

When I try to list the clusters using dbcListClusters I have the following error

[trace] Stack trace suppressed: run 'last *:dbcFetchClusters' for the full output.
[error] (*:dbcFetchClusters) org.apache.http.client.HttpResponseException: Bad Request
[error] Total time: 3 s, completed 28 mars 2019 16:18:54

Can you relate to this error ?

Thanks

scala apache-spark intellij-idea sbt azure-databricks

share|improve this question

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

add a comment
 | 

I'm trying to launch my Spark code that i've written in Intellij and run it on Databricks, so I've found that it can be done by "sbt-databricks" plugin.

Here is my build.sbt file :

name := "DatabricksTest"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies ++= Seq("org.apache.spark" %% "spark-core" % "2.4.0" //% "provided"
 ,"org.apache.spark" %% "spark-sql" % "2.4.0" //% "provided",
 )

dbcUsername := "token"//

dbcPassword := "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"// 

dbcApiUrl := "https://westeurope.azuredatabricks.net/api/1.2"//

dbcClusters += "Cluster1"

And here is my plugins.sbt file:

addSbtPlugin("com.databricks" %% "sbt-databricks" % "0.1.5")

When I try to list the clusters using dbcListClusters I have the following error

[trace] Stack trace suppressed: run 'last *:dbcFetchClusters' for the full output.
[error] (*:dbcFetchClusters) org.apache.http.client.HttpResponseException: Bad Request
[error] Total time: 3 s, completed 28 mars 2019 16:18:54

Can you relate to this error ?

Thanks

scala apache-spark intellij-idea sbt azure-databricks

share|improve this question

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

name := "DatabricksTest"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies ++= Seq("org.apache.spark" %% "spark-core" % "2.4.0" //% "provided"
 ,"org.apache.spark" %% "spark-sql" % "2.4.0" //% "provided",
 )

dbcUsername := "token"//

dbcPassword := "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"// 

dbcApiUrl := "https://westeurope.azuredatabricks.net/api/1.2"//

dbcClusters += "Cluster1"

addSbtPlugin("com.databricks" %% "sbt-databricks" % "0.1.5")

[trace] Stack trace suppressed: run 'last *:dbcFetchClusters' for the full output.
[error] (*:dbcFetchClusters) org.apache.http.client.HttpResponseException: Bad Request
[error] Total time: 3 s, completed 28 mars 2019 16:18:54

share|improve this question

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

share|improve this question

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges

asked Mar 28 at 15:34

I.ChorfiI.Chorfi

8399 bronze badges