perfomance is very bad when using gpu-image

[TieuNhi95]

I'm using the gpu-image module, I realize that the performance is bad, the video is quite lagging although the device performance is very good. When I comment these 2 lines, it runs very smoothly; so, having any way to optimize it? Thanks.

CameraCapturerFactory.getInstance().setCustomCameraCapturerOptions(createCustomCameraCapturerOptions());
CameraCapturerFactory.getInstance().setCameraType(CameraCapturerFactory.CameraType.CUSTOM);

[flashphoner]

When you comment those lines, you disable GPUImage filtering, because it works using custom camera capturer.
Please clarify: is the problem reproducing in Camera Manager example from latest build archive? If not, please modify the example minimally to reproduce the problem and provide us the code.
If yes, please clarify on what device do you testing? We've tested it on Nokia 5 (SoC Qualcomm Snapdragon 430, GPU Adreno 505), and video was playing smoothly during the tests.

[TieuNhi95]

@flashphoner
I'm so sorry for not explaining clearly. I tried running the gpu-image module, it runs quite smoothly because (by default ) you don't set the resolution for it. When I debug , the frame on my device is only 320 x 240, it's really dim. When I add the code as below to set the resolution up to 640 x 360 and expand the local_video_view to see it, I realize a problem of lag, drop frame.

StreamOptions streamOptions = new StreamOptions(streamName);
Constraints constraints = new Constraints(true, true);
VideoConstraints videoConstraints = new VideoConstraints();
videoConstraints.setVideoFps(15);
videoConstraints.setResolution(640,360);
constraints.setVideoConstraints(videoConstraints);
streamOptions.setConstraints(constraints);

[flashphoner]

When I debug , the frame on my device is only 320 x 240, it's really dim. When I add the code as below to set the resolution up to 640 x 360 and expand the local_video_view to see it, I realize a problem of lag, drop frame.

What device do you use for testing? Please don't use emulator, PC perfomance may be not enough for WebRTC streaming in this case.
Also, please check if lag and frame drop occurs in local view on the device where you publish, or in remote view on another device where you play.

[TieuNhi95]

@flashphoner
I am testing on the devices as below :

• Samsung galaxy A32 (very laggy)
• Xiaomi redmi note 8.
• Vsmart joy 4.
• Google Pixel 2XL.
  The lagging occurs in the local view running on the devices when I publish.

[flashphoner]

We raised a ticket WCS-3339 to add ability to change resolution in GPUImage and CameraManager examples and to test. Will let you know about results here.

[tienphi]

We raised a ticket WCS-3339

@flashphoner, I can’t find this ticket. Can you show me where can I view this ticket, please!

[flashphoner]

Usually, we use the forum https://forum.flashphoner.com/ as public bug tracker.
But you've not created a topic there, so we let you know in this thread about WCS-3339 state.
Preliminary results: the problem is in gpu-image library itself, its perfomance drops even on powerful hardware (for example, on Google Pixel 3 and Samsung S10+ publishing FPS drops since 1024x768 and bigger resolutions. So we are refactoring Camera Manager example to make easy to integrate any other filtering library.

[tienphi]

I also created a topic at this forum, please check this @flashphoner, thank
https://forum.flashphoner.com/threads/performance-is-bad-when-using-gpu-image.13986/