Styjun

Is it unusual for a math department not to have a mail/web server?

What was the point of "Substance"?

Stolen MacBook should I worry about my data?

Why is explainability not one of the criteria for publication?

Does trying to charm an uncharmable creature cost a spell slot?

Pen test results for web application include a file from a forbidden directory that is not even used or referenced

Did ancient peoples ever hide their treasure behind puzzles?

Why is there not a willingness from the world to step in between Pakistan and India?

Is the internet in Madagascar faster than in UK?

Force SQL Server to use fragmented indexes?

Can I use coax outlets for cable modem?

Commercial company wants me to list all prior "inventions", give up everything not listed

How to say "I only speak one which is English." in French?

If I said I had $100 when asked, but I actually had $200, would I be lying by omission?

Was a star-crossed lover

Dotted background on a flowchart

Are strlen optimizations really needed in glibc?

Half filled water bottle

Fantasy Macro Economics: What would Merfolk Trade?

Talk interpreter

To what extent should we fear giving offense?

How do I insert two edge loops equally spaced from the edges?

Counting the number of strings starting with "t" and containing 2 vowels and 2 consonants

Shift lens vs move body?

How to convert scientific notation stored as string to int in pandas dataframe?

How do I parse a string to a float or int?Converting string into datetimeConvert bytes to a string?Converting integer to string?Selecting multiple columns in a pandas dataframeAdding new column to existing DataFrame in Python pandasDelete column from pandas DataFrameHow to iterate over rows in a DataFrame in Pandas?Select rows from a DataFrame based on values in a column in pandasGet list from pandas DataFrame column headers

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

1

I have a column in a dataframe in pandas that is storing scientific notations as strings. I want to convert them strings to integers. But i am running into an issue that is best described by the code snippet below

Expected behavior:

print(int(float('9.01E+26')))
output:
901000000000000035886465024

Behaviour i am getting:

a = pd.Series('a':'9.01E+26')
print(a.astype(float).astype(int))
output:
a -9223372036854775808
dtype: int64

How do i go about achieving the expected behavior?

python pandas

share|improve this question

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Interesting. I assume this is on Windows (edit: nevermind, you would have got dtype: int32 if it was). The default int type used by numpy is 32 bit on Windows, but indeed this overflows np.int64 too. It's not clear how to get python int behaviour that doesn't overflow
  
  – roganjosh
  Mar 27 at 20:40
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  In fact, I'm suspecting that you simply cannot work with integers of this size in numpy. You'd either need floats or work with python list comprehensions instead. Could be wrong, though.
  
  – roganjosh
  Mar 27 at 20:45
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  .apply would be the way to go then i guess?
  
  – MiloMinderbinder
  Mar 27 at 20:46
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  That will give you OverflowError: int too big to convert. There must be some interim dtype going from np.float to a regular Python int that simply blocks the conversion
  
  – roganjosh
  Mar 27 at 20:48
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  ohh that so? i was thinking that since int(float('9.01E+26')) works... .apply would work too
  
  – MiloMinderbinder
  Mar 27 at 20:49
  

  
  
  
  

 | 
show 7 more comments

1

I have a column in a dataframe in pandas that is storing scientific notations as strings. I want to convert them strings to integers. But i am running into an issue that is best described by the code snippet below

Expected behavior:

print(int(float('9.01E+26')))
output:
901000000000000035886465024

Behaviour i am getting:

a = pd.Series('a':'9.01E+26')
print(a.astype(float).astype(int))
output:
a -9223372036854775808
dtype: int64

How do i go about achieving the expected behavior?

python pandas

share|improve this question

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Interesting. I assume this is on Windows (edit: nevermind, you would have got dtype: int32 if it was). The default int type used by numpy is 32 bit on Windows, but indeed this overflows np.int64 too. It's not clear how to get python int behaviour that doesn't overflow
  
  – roganjosh
  Mar 27 at 20:40
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  In fact, I'm suspecting that you simply cannot work with integers of this size in numpy. You'd either need floats or work with python list comprehensions instead. Could be wrong, though.
  
  – roganjosh
  Mar 27 at 20:45
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  .apply would be the way to go then i guess?
  
  – MiloMinderbinder
  Mar 27 at 20:46
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  That will give you OverflowError: int too big to convert. There must be some interim dtype going from np.float to a regular Python int that simply blocks the conversion
  
  – roganjosh
  Mar 27 at 20:48
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  ohh that so? i was thinking that since int(float('9.01E+26')) works... .apply would work too
  
  – MiloMinderbinder
  Mar 27 at 20:49
  

  
  
  
  

 | 
show 7 more comments

I have a column in a dataframe in pandas that is storing scientific notations as strings. I want to convert them strings to integers. But i am running into an issue that is best described by the code snippet below

Expected behavior:

print(int(float('9.01E+26')))
output:
901000000000000035886465024

Behaviour i am getting:

a = pd.Series('a':'9.01E+26')
print(a.astype(float).astype(int))
output:
a -9223372036854775808
dtype: int64

How do i go about achieving the expected behavior?

python pandas

share|improve this question

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

print(int(float('9.01E+26')))
output:
901000000000000035886465024

a = pd.Series('a':'9.01E+26')
print(a.astype(float).astype(int))
output:
a -9223372036854775808
dtype: int64

share|improve this question

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

share|improve this question

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges

asked Mar 27 at 20:37

MiloMinderbinderMiloMinderbinder

78877 silver badges1616 bronze badges