pool map no performance gainPython reverse / invert a mappingList comprehension vs mapKeyboard Interrupts with python's multiprocessing PoolThreading pool similar to the multiprocessing Pool?Show the progress of a Python multiprocessing pool map call?multiprocessing.Pool: When to use apply, apply_async or map?Python multiprocessing: no performance gain with multiple processesHow to read in a video file with cv2.VideoCapture?Segmentation fault OpenCV cap.read udp stream PythonMove a function into a thread for faster process in python
Published paper containing well-known results
Does entangle require vegetation?
Why is dry soil hydrophobic? Bad gardener paradox
Confused about 誘われて (Sasowarete)
Why would an Inquisitive rogue choose to use Insightful Fighting as opposed to using their Cunning Action to Hide?
Mistakenly modified `/bin/sh'
What is the English equivalent of 干物女 (dried fish woman)?
Why are Japanese translated subtitles non-conversational?
Why would guns not work in the dungeon?
Evaluating an integral symbolically
Meaning of slash chord without anything left of the slash
Bob's unnecessary trip to the shops
Why does the autopilot disengage even when it does not receive pilot input?
Too many spies!
Are there any double stars that I can actually see orbit each other?
How can an advanced civilization forget how to manufacture its technology?
Why does Hellboy file down his horns?
What is this old "lemon-squeezer" shaped pan
Why do they not say "The Baby"
What's the difference between soft PWM and PWM
Do native speakers use ZVE or CPU?
Integral clarification
Add region constraint to Graphics
Why does the trade federation become so alarmed upon learning the ambassadors are Jedi Knights?
pool map no performance gain
Python reverse / invert a mappingList comprehension vs mapKeyboard Interrupts with python's multiprocessing PoolThreading pool similar to the multiprocessing Pool?Show the progress of a Python multiprocessing pool map call?multiprocessing.Pool: When to use apply, apply_async or map?Python multiprocessing: no performance gain with multiple processesHow to read in a video file with cv2.VideoCapture?Segmentation fault OpenCV cap.read udp stream PythonMove a function into a thread for faster process in python
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I'm doing video capture from opencv using the following
frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)
In function pipeline:
df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)
compute is:
def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car
I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.
python multiprocessing
add a comment |
I'm doing video capture from opencv using the following
frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)
In function pipeline:
df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)
compute is:
def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car
I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.
python multiprocessing
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
@Jean-FrançoisFabredetis tensor flow detector, is that the problem ?
– waleed saleh
Mar 26 at 6:29
add a comment |
I'm doing video capture from opencv using the following
frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)
In function pipeline:
df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)
compute is:
def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car
I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.
python multiprocessing
I'm doing video capture from opencv using the following
frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)
In function pipeline:
df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)
compute is:
def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car
I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.
python multiprocessing
python multiprocessing
edited Mar 26 at 6:07
Arkistarvh Kltzuonstev
3,3862 gold badges13 silver badges35 bronze badges
3,3862 gold badges13 silver badges35 bronze badges
asked Mar 26 at 6:03
waleed salehwaleed saleh
145 bronze badges
145 bronze badges
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
@Jean-FrançoisFabredetis tensor flow detector, is that the problem ?
– waleed saleh
Mar 26 at 6:29
add a comment |
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
@Jean-FrançoisFabredetis tensor flow detector, is that the problem ?
– waleed saleh
Mar 26 at 6:29
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
@Jean-FrançoisFabre
det is tensor flow detector, is that the problem ?– waleed saleh
Mar 26 at 6:29
@Jean-FrançoisFabre
det is tensor flow detector, is that the problem ?– waleed saleh
Mar 26 at 6:29
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55350744%2fpool-map-no-performance-gain%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55350744%2fpool-map-no-performance-gain%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
can you show the type of the pool objects?
– Jean-François Fabre♦
Mar 26 at 6:14
pool_1 = Pool(2) pool_2 = Pool(2)
– waleed saleh
Mar 26 at 6:16
from multiprocessing import Pool, Queue
– waleed saleh
Mar 26 at 6:17
@Jean-FrançoisFabre
detis tensor flow detector, is that the problem ?– waleed saleh
Mar 26 at 6:29