exchange of measurement errors in 2d arrayIs there a NumPy function to return the first index of something in an array?How to print the full NumPy array, without truncation?error: Unable to find vcvarsall.batNumpy array dimensionsPeak detection in a 2D arrayHow to access the ith column of a NumPy multidimensional array?Dump a NumPy array into a csv fileMeasure time elapsed in Python?Convert pandas dataframe to NumPy arrayfatal error: Python.h: No such file or directory
Is there a set of positive integers of density 1 which contains no infinite arithmetic progression?
How to trick the reader into thinking they're following a redshirt instead of the protagonist?
Is it expected that a reader will skip parts of what you write?
Longest bridge/tunnel that can be cycled over/through?
How to hide rifle during medieval town entrance inspection?
Can the removal of a duty-free sales trolley result in a measurable reduction in emissions?
Explain the ending of Black Mirror's "Smithereens"
Bb13b9 confusion
How can I make 12 tone and atonal melodies sound interesting?
Fermat's statement about the ancients: How serious was he?
Why did Intel abandon unified CPU cache?
60s or 70s novel about Empire of Man making 1st contact with 1st discovered alien race
How can I end combat quickly when the outcome is inevitable?
Why am I Seeing A Weird "Notch" on the Data Line For Some Logical 1s?
Live action TV show where High school Kids go into the virtual world and have to clear levels
Printing Pascal’s triangle for n number of rows in Python
Which languages would be most useful in Europe at the end of the 19th century?
Is using 'echo' to display attacker-controlled data on the terminal dangerous?
How to “listen” to existing circuit
A map of non-pathological topology?
Next date with distinct digits
What aircraft was used as Air Force One for the flight between Southampton and Shannon?
Who won a Game of Bar Dice?
How can I remove material from this wood beam?
exchange of measurement errors in 2d array
Is there a NumPy function to return the first index of something in an array?How to print the full NumPy array, without truncation?error: Unable to find vcvarsall.batNumpy array dimensionsPeak detection in a 2D arrayHow to access the ith column of a NumPy multidimensional array?Dump a NumPy array into a csv fileMeasure time elapsed in Python?Convert pandas dataframe to NumPy arrayfatal error: Python.h: No such file or directory
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:
X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])
Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000
). I define them with an interval (e.g.: <-10, >1000
). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.
I already had a few attempts with the Panda's function asfreq()
and imputation class from scikit-learn. With asfreq()
I had the problem that it only fills NaN
values. With imputer()
there are only the four strategies (mean, median, most frequent and constant).
python pandas numpy scikit-learn
|
show 1 more comment
I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:
X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])
Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000
). I define them with an interval (e.g.: <-10, >1000
). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.
I already had a few attempts with the Panda's function asfreq()
and imputation class from scikit-learn. With asfreq()
I had the problem that it only fills NaN
values. With imputer()
there are only the four strategies (mean, median, most frequent and constant).
python pandas numpy scikit-learn
1
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
interpolated values
– mweisbr
Mar 25 at 7:31
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39
|
show 1 more comment
I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:
X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])
Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000
). I define them with an interval (e.g.: <-10, >1000
). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.
I already had a few attempts with the Panda's function asfreq()
and imputation class from scikit-learn. With asfreq()
I had the problem that it only fills NaN
values. With imputer()
there are only the four strategies (mean, median, most frequent and constant).
python pandas numpy scikit-learn
I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:
X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])
Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000
). I define them with an interval (e.g.: <-10, >1000
). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.
I already had a few attempts with the Panda's function asfreq()
and imputation class from scikit-learn. With asfreq()
I had the problem that it only fills NaN
values. With imputer()
there are only the four strategies (mean, median, most frequent and constant).
python pandas numpy scikit-learn
python pandas numpy scikit-learn
asked Mar 24 at 19:59
mweisbrmweisbr
11
11
1
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
interpolated values
– mweisbr
Mar 25 at 7:31
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39
|
show 1 more comment
1
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
interpolated values
– mweisbr
Mar 25 at 7:31
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39
1
1
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
interpolated values
– mweisbr
Mar 25 at 7:31
interpolated values
– mweisbr
Mar 25 at 7:31
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39
|
show 1 more comment
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55327999%2fexchange-of-measurement-errors-in-2d-array%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55327999%2fexchange-of-measurement-errors-in-2d-array%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
What would you like values to be filled with? Your question is a little broad.
– FChm
Mar 24 at 20:06
interpolated values
– mweisbr
Mar 25 at 7:31
Sure, but what method of interpolation do you want?
– FChm
Mar 25 at 8:06
that depends on the results. I have experimented with cubic splines or the Akima method.
– mweisbr
Mar 25 at 14:50
Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?
– FChm
Mar 25 at 15:39