Styjun

How can I find out about the game world without meta-influencing it?

Lightning Web Component (LWC) not evaluating if:true from test

Was the Lonely Mountain, where Smaug lived, a volcano?

What is the color associated with lukewarm?

Print "N NE E SE S SW W NW"

Why is gun control associated with the socially liberal Democratic party?

Realistic, logical way for men with medieval-era weaponry to compete with much larger and physically stronger foes

What publication claimed that Michael Jackson died in a nuclear holocaust?

Any gotchas in buying second-hand sanitary ware?

Placement of positioning lights on A320 winglets

Why does this Apple //e drops into system monitor when booting?

What does the "titan" monster tag mean?

Parallelized for loop in Bash

Am I being scammed by a sugar daddy?

Are athletes' college degrees discounted by employers and graduate school admissions?

Background for black and white chart

How can this shape perfectly cover a cube?

Does WiFi affect the quality of images downloaded from the internet?

Print the phrase "And she said, 'But that's his.'" using only the alphabet

typeid("") != typeid(const char*)

Why is C++ template use not recommended in space/radiated environment?

My parents claim they cannot pay for my college education; what are my options?

Is pointing finger in meeting consider bad?

Should I worry about having my credit pulled multiple times while car shopping?

How to fix “java.lang.Integer cannot be cast to java.lang.Double” Error in Spark (Scala)?

Extract column values of Dataframe as List in Apache SparkIn spark and scala, how to convert or map a dataframe to specific columns info?cast schema of a data frame in Spark and Scalascala/spark map returning an array instead of single valueSpark Scala replace Dataframe blank records to “0”how to get multiple rows from one row in spark scalaLinear Regression Apache Spark with Scala not even straight lineSpark-Scala Convert String of Numbers to DoubleError displaying data from Hive table in Spark program: DoubleWritable cannot be cast to TextHow to Convert RDD[(int, string)] to Dataframe in scala

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

-3

I have a 2 column (1 int and 1 double) dataframe "fit_comparison", of predicted values and linear regression results.

I have used the following code to get regression metrics:

val rm = new RegressionMetrics(
 fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Double], x(1).asInstanceOf[Double])))

When I try to get specific regression metrics as below, I get the "java.lang.Integer cannot be case to java.lang.Double" error.

println("MSE: " + rm.meanSquaredError)

Do I first have to convert the first column of "fit_comparison" to a double?

Any help is appreciated, thank you,

scala apache-spark

share|improve this question

asked Mar 25 at 0:50

mackabramackabra

82

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  "Do I first have to convert the first column of "fit_comparison" to a double?" -- Yeah ...
  
  – Dima
  Mar 25 at 0:55
  

  
  
  
  

add a comment | 

-3

I have a 2 column (1 int and 1 double) dataframe "fit_comparison", of predicted values and linear regression results.

I have used the following code to get regression metrics:

val rm = new RegressionMetrics(
 fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Double], x(1).asInstanceOf[Double])))

When I try to get specific regression metrics as below, I get the "java.lang.Integer cannot be case to java.lang.Double" error.

println("MSE: " + rm.meanSquaredError)

Do I first have to convert the first column of "fit_comparison" to a double?

Any help is appreciated, thank you,

scala apache-spark

share|improve this question

asked Mar 25 at 0:50

mackabramackabra

82

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  "Do I first have to convert the first column of "fit_comparison" to a double?" -- Yeah ...
  
  – Dima
  Mar 25 at 0:55
  

  
  
  
  

add a comment | 

I have a 2 column (1 int and 1 double) dataframe "fit_comparison", of predicted values and linear regression results.

I have used the following code to get regression metrics:

val rm = new RegressionMetrics(
 fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Double], x(1).asInstanceOf[Double])))

When I try to get specific regression metrics as below, I get the "java.lang.Integer cannot be case to java.lang.Double" error.

println("MSE: " + rm.meanSquaredError)

Do I first have to convert the first column of "fit_comparison" to a double?

Any help is appreciated, thank you,

scala apache-spark

share|improve this question

asked Mar 25 at 0:50

mackabramackabra

82

val rm = new RegressionMetrics(
 fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Double], x(1).asInstanceOf[Double])))

println("MSE: " + rm.meanSquaredError)

share|improve this question

asked Mar 25 at 0:50

mackabramackabra

82

share|improve this question

asked Mar 25 at 0:50

mackabramackabra

82

asked Mar 25 at 0:50

mackabramackabra

82

asked Mar 25 at 0:50

mackabramackabra

82

1 Answer
1

active

oldest

votes

4

You can try this :

val rm = new RegressionMetrics
(fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Int].toDouble, 
 x(1).asInstanceOf[Int].toDouble)))

share|improve this answer

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @ArthurSowinski Then you should accept the answer: stackoverflow.com/help/someone-answers
  
  – Alexey Romanov
  Mar 25 at 7:19
  

  
  
  
  

add a comment | 

Your Answer

StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55330029%2fhow-to-fix-java-lang-integer-cannot-be-cast-to-java-lang-double-error-in-spark%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

4

You can try this :

val rm = new RegressionMetrics
(fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Int].toDouble, 
 x(1).asInstanceOf[Int].toDouble)))

share|improve this answer

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @ArthurSowinski Then you should accept the answer: stackoverflow.com/help/someone-answers
  
  – Alexey Romanov
  Mar 25 at 7:19
  

  
  
  
  

add a comment | 

4

You can try this :

val rm = new RegressionMetrics
(fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Int].toDouble, 
 x(1).asInstanceOf[Int].toDouble)))

share|improve this answer

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  @ArthurSowinski Then you should accept the answer: stackoverflow.com/help/someone-answers
  
  – Alexey Romanov
  Mar 25 at 7:19
  

  
  
  
  

add a comment | 

You can try this :

val rm = new RegressionMetrics
(fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Int].toDouble, 
 x(1).asInstanceOf[Int].toDouble)))

share|improve this answer

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

val rm = new RegressionMetrics
(fit_comparison.rdd.map(x =>
 (x(0).asInstanceOf[Int].toDouble, 
 x(1).asInstanceOf[Int].toDouble)))

share|improve this answer

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263

answered Mar 25 at 2:13

Francoceing CFrancoceing C

1263