Styjun

Can I submit a paper under an alias so as to avoid trouble in my country?

Are required indicators necessary for radio buttons?

Can pay be witheld for hours cleaning up after closing time?

Is there a SubImageApply?

Does Swashbuckler's Fancy Footwork apply if the attack was made with Booming Blade?

What is the evidence on the danger of feeding whole blueberries and grapes to infants and toddlers?

Why don't sharp and flat root note chords seem to be present in much guitar music?

How to think about joining a company whose business I do not understand?

Potential new partner angry about first collaboration - how to answer email to close up this encounter in a graceful manner

!I!n!s!e!r!t! !n!b!e!t!w!e!e!n!

What is the difference between a premise and an assumption in logic?

Why is 日本 read as "nihon" but not "nitsuhon"?

Why does my house heat up, even when it's cool outside?

Can you be convicted for being a murderer twice?

Do I have to learn /o/ or /ɔ/ separately?

What can I do to keep a threaded bolt from falling out of it’s slot

How can I support the recycling, but not the new production of aluminum?

Why were movies shot on film shot at 24 frames per second?

Don't teach Dhamma to those who can't appreciate it or aren't interested

Nuclear decay triggers

Is "stainless" a bulk or a surface property of stainless steel?

jersey vs sweater

What are the pros and cons of Einstein-Cartan Theory?

Was 'help' pronounced starting with a vowel sound?

Get sum of specific rows in PySpark

How to sum array of numbers in Ruby?Converting a Pandas GroupBy output from Series to DataFrameHow can I replace all the NaN values with Zero's in a column of a pandas dataframeHow to iterate over rows in a DataFrame in Pandas?Select rows from a DataFrame based on values in a column in pandasHow to store a dataframe using PandasDivide Column in Pandas Dataframe by Sum of ColumnPyspark : Cumulative Sum with reset conditionCould not get sum of each row in a column in php mysql tableFill in specific row in pySpark dataframe while adding new columns

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

0

I have this dataframe

+----+-----+-----+
|Cat |01/02|02/02|......
+----+-----+-----+
| a | 20 | 7 |......
| b | 30 | 12 |......
| c | 10 | 10 |
 All| 60 | 29 |......
+----+---+-------+

I want the total to be this sum Total = a +b -c . Right now I am using this script

dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

I tried to calculate the desired outcome by doing this

pr = col("Cat")=='b'
dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c) - when(pr, F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

but I am getting null in the total. Any hints?

dataframe pyspark sum

share|improve this question

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

add a comment | 

0

I have this dataframe

+----+-----+-----+
|Cat |01/02|02/02|......
+----+-----+-----+
| a | 20 | 7 |......
| b | 30 | 12 |......
| c | 10 | 10 |
 All| 60 | 29 |......
+----+---+-------+

I want the total to be this sum Total = a +b -c . Right now I am using this script

dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

I tried to calculate the desired outcome by doing this

pr = col("Cat")=='b'
dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c) - when(pr, F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

but I am getting null in the total. Any hints?

dataframe pyspark sum

share|improve this question

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

add a comment | 

I have this dataframe

+----+-----+-----+
|Cat |01/02|02/02|......
+----+-----+-----+
| a | 20 | 7 |......
| b | 30 | 12 |......
| c | 10 | 10 |
 All| 60 | 29 |......
+----+---+-------+

I want the total to be this sum Total = a +b -c . Right now I am using this script

dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

I tried to calculate the desired outcome by doing this

pr = col("Cat")=='b'
dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c) - when(pr, F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

but I am getting null in the total. Any hints?

dataframe pyspark sum

share|improve this question

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

+----+-----+-----+
|Cat |01/02|02/02|......
+----+-----+-----+
| a | 20 | 7 |......
| b | 30 | 12 |......
| c | 10 | 10 |
 All| 60 | 29 |......
+----+---+-------+

dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

pr = col("Cat")=='b'
dfFrc = fs.union(fs.select(F.lit("Total").alias("Cat"), *[F.sum(F.col(c) - when(pr, F.col(c)).alias(c) for c in fs.columns if c != 'Cat']))

share|improve this question

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

share|improve this question

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges

asked Mar 27 at 15:29

Gerasimos Gerasimos

7411 gold badge22 silver badges1313 bronze badges