Styjun

Can tefillin be "switched"?

Compiling C files on Ubuntu and using the executable on Windows

How can this tool find out registered domains from an IP?

Is open-sourcing the code of a webapp not recommended?

How to forge a multi-part weapon?

How come the nude protesters were not arrested?

How did old MS-DOS games utilize various graphic cards?

Winning Strategy for the Magician and his Apprentice

English word for "product of tinkering"

Is it a problem if <h4>, <h5> and <h6> are smaller than regular text?

Difference between > and >> when used with a named pipe

Fixing obscure 8080 emulator bug?

Why would future John risk sending back a T-800 to save his younger self?

Logarithm of exponential

Is counterpoint still used today?

Is it legal for a bar bouncer to conficaste a fake ID

Taxi Services at Didcot

How to return a security deposit to a tenant

Pre-1972 sci-fi short story or novel: alien(?) tunnel where people try new moves and get destroyed if they're not the correct ones

How can I tell the difference between unmarked sugar and stevia?

What is the `some` keyword in SwiftUI?

Why didn't Voldemort recognize that Dumbledore was affected by his curse?

How does an ordinary object become radioactive?

Can U.S. Tax Forms Be Legally HTMLified?

IMFTransform covert camera stream color format, IMFTransform::ProcessOutput returns freeze image data

Camera video stream inside CAOpenGLLayerMFT Custom image FiltersIMFTransform interface of Color Converter DSP giving E_INVALIDARG on SetInputType/SetOutputTypeconverting a stream media type while using IMFSourceReaderCreating NV12 encoded video using windows media foundationMedia Foundation is incorrectly marking still image capture stream descriptors as video captureWindows Media Foundation using IMFTransform to decode mp4 movie frames to 2D texturesWebcam MJPG capture streams are unavailable on Windows 10How do I extract color matrix from MP4 an x264 stream in Media FoundationSharpDX MapSubresource is vertically flipped C#

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

0

I'm very new to Windows Media Foundation API. I try to create a program that can display and manipulate camera video input stream.

I'm using Media Foundation for video stream reading, the supportted color format is NV12, so I had to convert it to RGB or ARGB to create Opengl texture object.

I tried to do it using pure c++ code on CPU side, but the perfomance is very bad. Then I tried to use IMFTranform to do color convertion, the performance is very good, but I got a strange problem.
IMFTransform::Process returns S_OK, but I keep getting freezed image output. The result image pixel are not updated in realtime, keeps getting freezed for many frames, and the freezing time is getting longer and longger. If I use pure c++ code the do the color convertion, then everything works fine.

Here are my code, https://gist.github.com/zhiqiang-li/16d1a6a1b00e8fb39847c8ca323b5604. Please let me konw what do you think I'm doing wrong.

camera ms-media-foundation color-conversion

share|improve this question

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

add a comment | 

0

I'm very new to Windows Media Foundation API. I try to create a program that can display and manipulate camera video input stream.

I'm using Media Foundation for video stream reading, the supportted color format is NV12, so I had to convert it to RGB or ARGB to create Opengl texture object.

I tried to do it using pure c++ code on CPU side, but the perfomance is very bad. Then I tried to use IMFTranform to do color convertion, the performance is very good, but I got a strange problem.
IMFTransform::Process returns S_OK, but I keep getting freezed image output. The result image pixel are not updated in realtime, keeps getting freezed for many frames, and the freezing time is getting longer and longger. If I use pure c++ code the do the color convertion, then everything works fine.

Here are my code, https://gist.github.com/zhiqiang-li/16d1a6a1b00e8fb39847c8ca323b5604. Please let me konw what do you think I'm doing wrong.

camera ms-media-foundation color-conversion

share|improve this question

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

add a comment | 

I'm very new to Windows Media Foundation API. I try to create a program that can display and manipulate camera video input stream.

I'm using Media Foundation for video stream reading, the supportted color format is NV12, so I had to convert it to RGB or ARGB to create Opengl texture object.

I tried to do it using pure c++ code on CPU side, but the perfomance is very bad. Then I tried to use IMFTranform to do color convertion, the performance is very good, but I got a strange problem.
IMFTransform::Process returns S_OK, but I keep getting freezed image output. The result image pixel are not updated in realtime, keeps getting freezed for many frames, and the freezing time is getting longer and longger. If I use pure c++ code the do the color convertion, then everything works fine.

Here are my code, https://gist.github.com/zhiqiang-li/16d1a6a1b00e8fb39847c8ca323b5604. Please let me konw what do you think I'm doing wrong.

camera ms-media-foundation color-conversion

share|improve this question

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

share|improve this question

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

share|improve this question

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

asked Mar 24 at 17:00

Zhiqiang LiZhiqiang Li

145114

1 Answer
1

active

oldest

votes

0

Did you try to let the SourceReader do the conversion for you :

hr = mAttributes->SetUINT32(MF_READWRITE_DISABLE_CONVERTERS, FALSE);

By default, the source reader and sink writer can perform some format conversions on uncompressed audio and video streams. To disable this behavior, set this attribute to TRUE when you create the source reader or sink writer.

By default it is FALSE, so you don't really need to explicitly set this attribute.

Then :

hr = mSourceReader->SetCurrentMediaType((DWORD)MF_SOURCE_READER_FIRST_VIDEO_STREAM, NULL, mediaType);

with :

mOutputMediaType->SetGUID(MF_MT_SUBTYPE, MFVideoFormat_NV12);

Also calculate image size according to NV12 format (MF_MT_FRAME_SIZE). Don't set MF_MT_DEFAULT_STRIDE, the SourceReader will do it for you.

So the idea is to get NV12 format from the SourceReader, even if the capture source gives RGB32 format. The SourceReader is normally able to do this.

share|improve this answer

edited Mar 24 at 21:24

answered Mar 24 at 21:13

mofo77mofo77

739412

add a comment | 

Your Answer

StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55326266%2fimftransform-covert-camera-stream-color-format-imftransformprocessoutput-retu%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

0

Did you try to let the SourceReader do the conversion for you :

hr = mAttributes->SetUINT32(MF_READWRITE_DISABLE_CONVERTERS, FALSE);

By default, the source reader and sink writer can perform some format conversions on uncompressed audio and video streams. To disable this behavior, set this attribute to TRUE when you create the source reader or sink writer.

By default it is FALSE, so you don't really need to explicitly set this attribute.

Then :

hr = mSourceReader->SetCurrentMediaType((DWORD)MF_SOURCE_READER_FIRST_VIDEO_STREAM, NULL, mediaType);

with :

mOutputMediaType->SetGUID(MF_MT_SUBTYPE, MFVideoFormat_NV12);

Also calculate image size according to NV12 format (MF_MT_FRAME_SIZE). Don't set MF_MT_DEFAULT_STRIDE, the SourceReader will do it for you.

So the idea is to get NV12 format from the SourceReader, even if the capture source gives RGB32 format. The SourceReader is normally able to do this.

share|improve this answer

edited Mar 24 at 21:24

answered Mar 24 at 21:13

mofo77mofo77

739412

add a comment | 

0

Did you try to let the SourceReader do the conversion for you :

hr = mAttributes->SetUINT32(MF_READWRITE_DISABLE_CONVERTERS, FALSE);

By default, the source reader and sink writer can perform some format conversions on uncompressed audio and video streams. To disable this behavior, set this attribute to TRUE when you create the source reader or sink writer.

By default it is FALSE, so you don't really need to explicitly set this attribute.

Then :

hr = mSourceReader->SetCurrentMediaType((DWORD)MF_SOURCE_READER_FIRST_VIDEO_STREAM, NULL, mediaType);

with :

mOutputMediaType->SetGUID(MF_MT_SUBTYPE, MFVideoFormat_NV12);

Also calculate image size according to NV12 format (MF_MT_FRAME_SIZE). Don't set MF_MT_DEFAULT_STRIDE, the SourceReader will do it for you.

So the idea is to get NV12 format from the SourceReader, even if the capture source gives RGB32 format. The SourceReader is normally able to do this.

share|improve this answer

edited Mar 24 at 21:24

answered Mar 24 at 21:13

mofo77mofo77

739412

add a comment | 

Did you try to let the SourceReader do the conversion for you :

hr = mAttributes->SetUINT32(MF_READWRITE_DISABLE_CONVERTERS, FALSE);

By default, the source reader and sink writer can perform some format conversions on uncompressed audio and video streams. To disable this behavior, set this attribute to TRUE when you create the source reader or sink writer.

By default it is FALSE, so you don't really need to explicitly set this attribute.

Then :

hr = mSourceReader->SetCurrentMediaType((DWORD)MF_SOURCE_READER_FIRST_VIDEO_STREAM, NULL, mediaType);

with :

mOutputMediaType->SetGUID(MF_MT_SUBTYPE, MFVideoFormat_NV12);

Also calculate image size according to NV12 format (MF_MT_FRAME_SIZE). Don't set MF_MT_DEFAULT_STRIDE, the SourceReader will do it for you.

So the idea is to get NV12 format from the SourceReader, even if the capture source gives RGB32 format. The SourceReader is normally able to do this.

share|improve this answer

edited Mar 24 at 21:24

answered Mar 24 at 21:13

mofo77mofo77

739412

hr = mAttributes->SetUINT32(MF_READWRITE_DISABLE_CONVERTERS, FALSE);

hr = mSourceReader->SetCurrentMediaType((DWORD)MF_SOURCE_READER_FIRST_VIDEO_STREAM, NULL, mediaType);

mOutputMediaType->SetGUID(MF_MT_SUBTYPE, MFVideoFormat_NV12);

share|improve this answer

edited Mar 24 at 21:24

answered Mar 24 at 21:13

mofo77mofo77

739412

answered Mar 24 at 21:13

mofo77mofo77

739412

answered Mar 24 at 21:13

mofo77mofo77

739412