Padding batch of uneven/unequal arrays in tensorflowNicest way to pad zeroes to a stringTensorflow: how to save/restore a model?Using a batchsize greater than 1 when using Tensorflows c++ APITensorFlow not found using pipTensorflow multiple samples without batchingTensorflow: LSTM and Convolution on subset of dimensions (avoiding unstack?)Tensorflow: building graph with batch sizes varying in dimension 1?Internally feeding to an intermediate tensorflow placeholderAttempted to use a closed SessionIndexing tensorflow output tensor in c++
How do I handle a DM that plays favorites with certain players?
how to change dot to underline in multiple file-names?
Why do my fried eggs start browning very fast?
What could prevent players from leaving an island?
How can I use commands with sudo without changing owner of the files?
The warlock of firetop mountain, what's the deal with reference 192?
A Checkmate of Dubious Legality
How easy is it to get a gun illegally in the United States?
If someone else uploads my GPL'd code to Github without my permission, is that a copyright violation?
Is there a booking app or site that lets you specify your gender for shared dormitories?
How do people drown while wearing a life jacket?
What does "autolyco-sentimental" mean?
How does Rust's 128-bit integer `i128` work on a 64-bit system?
Is an "are" omitted in this sentence
split inside flalign
What does C++ language definition say about the extent of the static keyword?
Can the Cauchy product of divergent series with itself be convergent?
Is it uncompelling to continue the story with lower stakes?
How to increase Solr JVM memory
How to call made-up data?
What license to choose for my PhD thesis?
Can a Hogwarts student refuse the Sorting Hat's decision?
What are the limitations of the Hendersson-Hasselbalch equation?
Awk to get all my regular users in shadow
Padding batch of uneven/unequal arrays in tensorflow
Nicest way to pad zeroes to a stringTensorflow: how to save/restore a model?Using a batchsize greater than 1 when using Tensorflows c++ APITensorFlow not found using pipTensorflow multiple samples without batchingTensorflow: LSTM and Convolution on subset of dimensions (avoiding unstack?)Tensorflow: building graph with batch sizes varying in dimension 1?Internally feeding to an intermediate tensorflow placeholderAttempted to use a closed SessionIndexing tensorflow output tensor in c++
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I am trying to pad a batch of lists so that I get a rectangular tensor. The context is that I want to run batch training on unequal feature vectors. I believe there should be a simple for doing this in tensorflow but I am unable to find it.
I have already tried "pre-padding" the feature vectors before passing it using feed_dict
and it works. However, I want to do this as a native Tensorflow operation as pre-padding in python might be slower than doing it in the graph.
def pad(train_features_list):
max_seq_len = max(len(features) for features in train_features_list)
for k, _ in enumerate(train_features_list):
pads_to_add = max_seq_len - len(train_features_list[k])
train_features_list[k].extend(['<PAD>'] * pads_to_add)
python tensorflow
add a comment |
I am trying to pad a batch of lists so that I get a rectangular tensor. The context is that I want to run batch training on unequal feature vectors. I believe there should be a simple for doing this in tensorflow but I am unable to find it.
I have already tried "pre-padding" the feature vectors before passing it using feed_dict
and it works. However, I want to do this as a native Tensorflow operation as pre-padding in python might be slower than doing it in the graph.
def pad(train_features_list):
max_seq_len = max(len(features) for features in train_features_list)
for k, _ in enumerate(train_features_list):
pads_to_add = max_seq_len - len(train_features_list[k])
train_features_list[k].extend(['<PAD>'] * pads_to_add)
python tensorflow
add a comment |
I am trying to pad a batch of lists so that I get a rectangular tensor. The context is that I want to run batch training on unequal feature vectors. I believe there should be a simple for doing this in tensorflow but I am unable to find it.
I have already tried "pre-padding" the feature vectors before passing it using feed_dict
and it works. However, I want to do this as a native Tensorflow operation as pre-padding in python might be slower than doing it in the graph.
def pad(train_features_list):
max_seq_len = max(len(features) for features in train_features_list)
for k, _ in enumerate(train_features_list):
pads_to_add = max_seq_len - len(train_features_list[k])
train_features_list[k].extend(['<PAD>'] * pads_to_add)
python tensorflow
I am trying to pad a batch of lists so that I get a rectangular tensor. The context is that I want to run batch training on unequal feature vectors. I believe there should be a simple for doing this in tensorflow but I am unable to find it.
I have already tried "pre-padding" the feature vectors before passing it using feed_dict
and it works. However, I want to do this as a native Tensorflow operation as pre-padding in python might be slower than doing it in the graph.
def pad(train_features_list):
max_seq_len = max(len(features) for features in train_features_list)
for k, _ in enumerate(train_features_list):
pads_to_add = max_seq_len - len(train_features_list[k])
train_features_list[k].extend(['<PAD>'] * pads_to_add)
python tensorflow
python tensorflow
asked Mar 27 at 2:51
Rajhans SamdaniRajhans Samdani
11 bronze badge
11 bronze badge
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55369072%2fpadding-batch-of-uneven-unequal-arrays-in-tensorflow%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55369072%2fpadding-batch-of-uneven-unequal-arrays-in-tensorflow%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown