Styjun

Where are the "shires" in the UK?

Change in "can't be countered" wording

Would you use "llamarse" for an animal's name?

Should I mention being denied entry to UK due to a confusion in my Visa and Ticket bookings?

To kill a cuckoo

Install LibreOffice-Writer Only not LibreOffice whole package

How does the reduce() method work in Java 8?

Why am I receiving the identity insert error even after explicitly setting IDENTITY_INSERT ON and using a column list?

Voltage Balun 1:1

Notation: What does the tilde bellow of the Expectation mean?

Out of scope work duties and resignation

Can I use a Cat5e cable with an RJ45 and Cat6 port?

Why would a military not separate its forces into different branches?

Why aren't nationalizations in Russia described as socialist?

Dangerous workplace travelling

Agena docking and RCS Brakes in First Man

What is a common way to tell if an academic is "above average," or outstanding in their field? Is their h-index (Hirsh index) one of them?

Would a small hole in a Faraday cage drastically reduce its effectiveness at blocking interference?

Start job from another SQL server instance

Is Soreness in Middle Knuckle of Fretting Hand Index Finger Normal for Beginners?

Can my 2 children, aged 10 and 12, who are US citizens, travel to the USA on expired American passports?

Can there be a single technologically advanced nation, in a continent full of non-technologically advanced nations?

Is there a word for food that's gone 'bad', but is still edible?

Indentation Tex

add additional row by index increasing for every line of row

Primary keys with Apache SparkAdd a row to a sql data frame by pysparkHow can I add a value to a row in pyspark?Proper use of flatMapPyspark filter out empty lists using .filter()How can I extend time index in pandas or pyspark?Pyspark Replicate Row based on column valuehow to map each column to other column in pyspark dataframe?Counting number of nulls in pyspark dataframe by rowMap a text file to key/value pair in order to group them in pysparkWhat is wrong with this Spark RDD mapped with a lambda function with two arguments?

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

0

ratings_test = test_data.map(lambda l: l.split()).map(lambda a : 
 Row(userId=int(a[0]),movieId=int(a[1]),index=i)).cache()

I want the index row to be increasing

pyspark pyspark-sql

share|improve this question

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Possible duplicate of Primary keys with Apache Spark
  
  – user10938362
  Mar 23 at 1:48
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Use the zipWithIndex method on the RDD
  
  – sramalingam24
  Mar 23 at 23:36
  

  
  
  
  

add a comment | 

0

ratings_test = test_data.map(lambda l: l.split()).map(lambda a : 
 Row(userId=int(a[0]),movieId=int(a[1]),index=i)).cache()

I want the index row to be increasing

pyspark pyspark-sql

share|improve this question

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Possible duplicate of Primary keys with Apache Spark
  
  – user10938362
  Mar 23 at 1:48
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Use the zipWithIndex method on the RDD
  
  – sramalingam24
  Mar 23 at 23:36
  

  
  
  
  

add a comment | 

ratings_test = test_data.map(lambda l: l.split()).map(lambda a : 
 Row(userId=int(a[0]),movieId=int(a[1]),index=i)).cache()

I want the index row to be increasing

pyspark pyspark-sql

share|improve this question

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

ratings_test = test_data.map(lambda l: l.split()).map(lambda a : 
 Row(userId=int(a[0]),movieId=int(a[1]),index=i)).cache()

share|improve this question

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

share|improve this question

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

edited Mar 23 at 0:49

Sterling Archer

16.1k136291

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1

asked Mar 22 at 22:19

vamsy vaddivamsy vaddi

1