pool map no performance gainPython reverse / invert a mappingList comprehension vs mapKeyboard Interrupts with python's multiprocessing PoolThreading pool similar to the multiprocessing Pool?Show the progress of a Python multiprocessing pool map call?multiprocessing.Pool: When to use apply, apply_async or map?Python multiprocessing: no performance gain with multiple processesHow to read in a video file with cv2.VideoCapture?Segmentation fault OpenCV cap.read udp stream PythonMove a function into a thread for faster process in python

Published paper containing well-known results

Does entangle require vegetation?

Why is dry soil hydrophobic? Bad gardener paradox

Confused about 誘われて (Sasowarete)

Why would an Inquisitive rogue choose to use Insightful Fighting as opposed to using their Cunning Action to Hide?

Mistakenly modified `/bin/sh'

What is the English equivalent of 干物女 (dried fish woman)?

Why are Japanese translated subtitles non-conversational?

Why would guns not work in the dungeon?

Evaluating an integral symbolically

Meaning of slash chord without anything left of the slash

Bob's unnecessary trip to the shops

Why does the autopilot disengage even when it does not receive pilot input?

Too many spies!

Are there any double stars that I can actually see orbit each other?

How can an advanced civilization forget how to manufacture its technology?

Why does Hellboy file down his horns?

What is this old "lemon-squeezer" shaped pan

Why do they not say "The Baby"

What's the difference between soft PWM and PWM

Do native speakers use ZVE or CPU?

Integral clarification

Add region constraint to Graphics

Why does the trade federation become so alarmed upon learning the ambassadors are Jedi Knights?



pool map no performance gain


Python reverse / invert a mappingList comprehension vs mapKeyboard Interrupts with python's multiprocessing PoolThreading pool similar to the multiprocessing Pool?Show the progress of a Python multiprocessing pool map call?multiprocessing.Pool: When to use apply, apply_async or map?Python multiprocessing: no performance gain with multiple processesHow to read in a video file with cv2.VideoCapture?Segmentation fault OpenCV cap.read udp stream PythonMove a function into a thread for faster process in python






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








2















I'm doing video capture from opencv using the following



frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)


In function pipeline:



df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)


compute is:



def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car


I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.










share|improve this question
























  • can you show the type of the pool objects?

    – Jean-François Fabre♦
    Mar 26 at 6:14











  • pool_1 = Pool(2) pool_2 = Pool(2)

    – waleed saleh
    Mar 26 at 6:16











  • from multiprocessing import Pool, Queue

    – waleed saleh
    Mar 26 at 6:17











  • @Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

    – waleed saleh
    Mar 26 at 6:29

















2















I'm doing video capture from opencv using the following



frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)


In function pipeline:



df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)


compute is:



def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car


I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.










share|improve this question
























  • can you show the type of the pool objects?

    – Jean-François Fabre♦
    Mar 26 at 6:14











  • pool_1 = Pool(2) pool_2 = Pool(2)

    – waleed saleh
    Mar 26 at 6:16











  • from multiprocessing import Pool, Queue

    – waleed saleh
    Mar 26 at 6:17











  • @Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

    – waleed saleh
    Mar 26 at 6:29













2












2








2








I'm doing video capture from opencv using the following



frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)


In function pipeline:



df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)


compute is:



def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car


I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.










share|improve this question
















I'm doing video capture from opencv using the following



frame_count = 90000
while f < frame_count:
ret, frame = cap.read()
f+=1
if (f > 41300):
dst = cv2.warpPerspective(frame.copy(), matrix, (frame.shape[1], frame.shape[0]))
pipeline(pool_1, pool_2, frame, car_tracker, ped_tracker, df_region, region_buffered, df_line_car, df_line_ped, det, dst, matrix)
cv2.imshow("frame", frame)
cv2.imshow('dst', dst)
cv2.waitKey(1)


In function pipeline:



df_cars= pool_1.map(compute, cars)
df_peds = pool_2.map(compute, peds)


compute is:



def compute(v):
gb = ('trajectory_id',)
global general_pd
id = v[0]
x = v[1]
y = v[2]
frame_id = v[3]
general_pd.loc[len(general_pd)] = [id, x,y, frame_id]
grouped = general_pd.loc[general_pd['trajectory_id'] == id]
df_region = v[4]
region_buffered = v[5]
df_line = v[6]
rpp = RawParameterProcessor(grouped, df_line, frame_idx, df_region, region_buffered, gb=gb)
df_parameter_car = rpp.compute()
return df_parameter_car


I don't know what I'm doing wrong, so that I can't get the correct performance gain, I launch two process, and each frame of the video capture I launch a process and do the jobs async, but I don't get any performance gain.







python multiprocessing






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 26 at 6:07









Arkistarvh Kltzuonstev

3,3862 gold badges13 silver badges35 bronze badges




3,3862 gold badges13 silver badges35 bronze badges










asked Mar 26 at 6:03









waleed salehwaleed saleh

145 bronze badges




145 bronze badges












  • can you show the type of the pool objects?

    – Jean-François Fabre♦
    Mar 26 at 6:14











  • pool_1 = Pool(2) pool_2 = Pool(2)

    – waleed saleh
    Mar 26 at 6:16











  • from multiprocessing import Pool, Queue

    – waleed saleh
    Mar 26 at 6:17











  • @Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

    – waleed saleh
    Mar 26 at 6:29

















  • can you show the type of the pool objects?

    – Jean-François Fabre♦
    Mar 26 at 6:14











  • pool_1 = Pool(2) pool_2 = Pool(2)

    – waleed saleh
    Mar 26 at 6:16











  • from multiprocessing import Pool, Queue

    – waleed saleh
    Mar 26 at 6:17











  • @Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

    – waleed saleh
    Mar 26 at 6:29
















can you show the type of the pool objects?

– Jean-François Fabre♦
Mar 26 at 6:14





can you show the type of the pool objects?

– Jean-François Fabre♦
Mar 26 at 6:14













pool_1 = Pool(2) pool_2 = Pool(2)

– waleed saleh
Mar 26 at 6:16





pool_1 = Pool(2) pool_2 = Pool(2)

– waleed saleh
Mar 26 at 6:16













from multiprocessing import Pool, Queue

– waleed saleh
Mar 26 at 6:17





from multiprocessing import Pool, Queue

– waleed saleh
Mar 26 at 6:17













@Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

– waleed saleh
Mar 26 at 6:29





@Jean-FrançoisFabre det is tensor flow detector, is that the problem ?

– waleed saleh
Mar 26 at 6:29












0






active

oldest

votes










Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55350744%2fpool-map-no-performance-gain%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes




Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.







Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.



















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55350744%2fpool-map-no-performance-gain%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

How to preserve electronics (computers, tablets and phones) for hundreds of years Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) The network's official Twitter account is up and running again. What content…How might modern humans leave a message for 50,000 years?How would an aquatic race develop computers?How do we make computers care for human life?Keeping supplies for 1000 yearsWhat will cell phones become in 100 years?What body armor protects against a laser?Could a society attain 1800s technology if limited to using copper and bronze?Electricity power (magic) and electronicsScavenging metal resources in post-apocalypse after 100 yearsWhy would precursors create devices that can survive and still work after hundreds of years?

155 수학 과학 기타 둘러보기 메뉴eh추가해eh문서를 완성해

Convert JSON to MapSimplest way to convert a string representing JSON array into Java array List of key value pairsHow to take String JSON values into HashMapConvert a JSON String to a HashMapCreating BSON object from JSON stringJSONObject - How to get a value ?Better Map ConstructorReading JSON from Url javaUpdate columns if input values are not null otherwise ignore and keep the existing values of column in databaseHow to store object represented as Json string into Couchbase Lite?Go JSON into MapHow do I efficiently iterate over each entry in a Java Map?Sort a Map<Key, Value> by valuesHow to round a number to n decimal places in JavaCan comments be used in JSON?How do I read / convert an InputStream into a String in Java?How can I pretty-print JSON in a shell script?What is the correct JSON content type?How can I deserialize JSON to a simple Dictionary<string,string> in ASP.NET?Why does Google prepend while(1); to their JSON responses?Parse JSON in JavaScript?