exchange of measurement errors in 2d arrayIs there a NumPy function to return the first index of something in an array?How to print the full NumPy array, without truncation?error: Unable to find vcvarsall.batNumpy array dimensionsPeak detection in a 2D arrayHow to access the ith column of a NumPy multidimensional array?Dump a NumPy array into a csv fileMeasure time elapsed in Python?Convert pandas dataframe to NumPy arrayfatal error: Python.h: No such file or directory

Is there a set of positive integers of density 1 which contains no infinite arithmetic progression?

How to trick the reader into thinking they're following a redshirt instead of the protagonist?

Is it expected that a reader will skip parts of what you write?

Longest bridge/tunnel that can be cycled over/through?

How to hide rifle during medieval town entrance inspection?

Can the removal of a duty-free sales trolley result in a measurable reduction in emissions?

Explain the ending of Black Mirror's "Smithereens"

Bb13b9 confusion

How can I make 12 tone and atonal melodies sound interesting?

Fermat's statement about the ancients: How serious was he?

Why did Intel abandon unified CPU cache?

60s or 70s novel about Empire of Man making 1st contact with 1st discovered alien race

How can I end combat quickly when the outcome is inevitable?

Why am I Seeing A Weird "Notch" on the Data Line For Some Logical 1s?

Live action TV show where High school Kids go into the virtual world and have to clear levels

Printing Pascal’s triangle for n number of rows in Python

Which languages would be most useful in Europe at the end of the 19th century?

Is using 'echo' to display attacker-controlled data on the terminal dangerous?

How to “listen” to existing circuit

A map of non-pathological topology?

Next date with distinct digits

What aircraft was used as Air Force One for the flight between Southampton and Shannon?

Who won a Game of Bar Dice?

How can I remove material from this wood beam?



exchange of measurement errors in 2d array


Is there a NumPy function to return the first index of something in an array?How to print the full NumPy array, without truncation?error: Unable to find vcvarsall.batNumpy array dimensionsPeak detection in a 2D arrayHow to access the ith column of a NumPy multidimensional array?Dump a NumPy array into a csv fileMeasure time elapsed in Python?Convert pandas dataframe to NumPy arrayfatal error: Python.h: No such file or directory






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:



X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])


Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000). I define them with an interval (e.g.: <-10, >1000). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.



I already had a few attempts with the Panda's function asfreq() and imputation class from scikit-learn. With asfreq() I had the problem that it only fills NaN values. With imputer() there are only the four strategies (mean, median, most frequent and constant).










share|improve this question

















  • 1





    What would you like values to be filled with? Your question is a little broad.

    – FChm
    Mar 24 at 20:06











  • interpolated values

    – mweisbr
    Mar 25 at 7:31











  • Sure, but what method of interpolation do you want?

    – FChm
    Mar 25 at 8:06











  • that depends on the results. I have experimented with cubic splines or the Akima method.

    – mweisbr
    Mar 25 at 14:50











  • Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

    – FChm
    Mar 25 at 15:39

















0















I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:



X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])


Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000). I define them with an interval (e.g.: <-10, >1000). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.



I already had a few attempts with the Panda's function asfreq() and imputation class from scikit-learn. With asfreq() I had the problem that it only fills NaN values. With imputer() there are only the four strategies (mean, median, most frequent and constant).










share|improve this question

















  • 1





    What would you like values to be filled with? Your question is a little broad.

    – FChm
    Mar 24 at 20:06











  • interpolated values

    – mweisbr
    Mar 25 at 7:31











  • Sure, but what method of interpolation do you want?

    – FChm
    Mar 25 at 8:06











  • that depends on the results. I have experimented with cubic splines or the Akima method.

    – mweisbr
    Mar 25 at 14:50











  • Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

    – FChm
    Mar 25 at 15:39













0












0








0








I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:



X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])


Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000). I define them with an interval (e.g.: <-10, >1000). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.



I already had a few attempts with the Panda's function asfreq() and imputation class from scikit-learn. With asfreq() I had the problem that it only fills NaN values. With imputer() there are only the four strategies (mean, median, most frequent and constant).










share|improve this question














I have very large evaluation data of strain readings which I import as 2d arrays into python. Short Example:



X = np.array([[210, 211, 209, 10000, 215, -5000],
[220, 221, 219, 10000, 225, -10000],
1400, 225, 230, 10000, 235, -98]])


Some measured values can be interpreted directly as measurement errors (e.g.:10000,-5000). I define them with an interval (e.g.: <-10, >1000). Then the values should be removed from the array and replaced by suitable values. The measurement errors should either be interpolated or replaced by other methods.



I already had a few attempts with the Panda's function asfreq() and imputation class from scikit-learn. With asfreq() I had the problem that it only fills NaN values. With imputer() there are only the four strategies (mean, median, most frequent and constant).







python pandas numpy scikit-learn






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 24 at 19:59









mweisbrmweisbr

11




11







  • 1





    What would you like values to be filled with? Your question is a little broad.

    – FChm
    Mar 24 at 20:06











  • interpolated values

    – mweisbr
    Mar 25 at 7:31











  • Sure, but what method of interpolation do you want?

    – FChm
    Mar 25 at 8:06











  • that depends on the results. I have experimented with cubic splines or the Akima method.

    – mweisbr
    Mar 25 at 14:50











  • Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

    – FChm
    Mar 25 at 15:39












  • 1





    What would you like values to be filled with? Your question is a little broad.

    – FChm
    Mar 24 at 20:06











  • interpolated values

    – mweisbr
    Mar 25 at 7:31











  • Sure, but what method of interpolation do you want?

    – FChm
    Mar 25 at 8:06











  • that depends on the results. I have experimented with cubic splines or the Akima method.

    – mweisbr
    Mar 25 at 14:50











  • Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

    – FChm
    Mar 25 at 15:39







1




1





What would you like values to be filled with? Your question is a little broad.

– FChm
Mar 24 at 20:06





What would you like values to be filled with? Your question is a little broad.

– FChm
Mar 24 at 20:06













interpolated values

– mweisbr
Mar 25 at 7:31





interpolated values

– mweisbr
Mar 25 at 7:31













Sure, but what method of interpolation do you want?

– FChm
Mar 25 at 8:06





Sure, but what method of interpolation do you want?

– FChm
Mar 25 at 8:06













that depends on the results. I have experimented with cubic splines or the Akima method.

– mweisbr
Mar 25 at 14:50





that depends on the results. I have experimented with cubic splines or the Akima method.

– mweisbr
Mar 25 at 14:50













Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

– FChm
Mar 25 at 15:39





Could you provide your some more context? What if your 2D array? Are the columns strain readings at different positions and the rows readings at different times?

– FChm
Mar 25 at 15:39












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55327999%2fexchange-of-measurement-errors-in-2d-array%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55327999%2fexchange-of-measurement-errors-in-2d-array%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

Swift 4 - func physicsWorld not invoked on collision? The Next CEO of Stack OverflowHow to call Objective-C code from Swift#ifdef replacement in the Swift language@selector() in Swift?#pragma mark in Swift?Swift for loop: for index, element in array?dispatch_after - GCD in Swift?Swift Beta performance: sorting arraysSplit a String into an array in Swift?The use of Swift 3 @objc inference in Swift 4 mode is deprecated?How to optimize UITableViewCell, because my UITableView lags

Access current req object everywhere in Node.js ExpressWhy are global variables considered bad practice? (node.js)Using req & res across functionsHow do I get the path to the current script with Node.js?What is Node.js' Connect, Express and “middleware”?Node.js w/ express error handling in callbackHow to access the GET parameters after “?” in Express?Modify Node.js req object parametersAccess “app” variable inside of ExpressJS/ConnectJS middleware?Node.js Express app - request objectAngular Http Module considered middleware?Session variables in ExpressJSAdd properties to the req object in expressjs with Typescript