Comparison between SRS and OvenSpace Demo does not show same behaviour over WebRTC stream retrieval

[antonymarion]

Describe the bug

Using OvenMediaEngine and DJI mini 3 PRO drone.

On LLHLS my stream is OK (the cursor is not very stable but the stream is smooth here)
on WebRTC it's lagged on our OME server, and on OvenSpace Demo Sandbox it's lagged too

To Reproduce
Steps to reproduce the behavior:

1. Use a DJI Drone mini 3 Pro to send to RTMP url the stream
2. Observe the stream with OvenMediaEngine: it's Lagged
3. Do the same with SRS: it's OK

Expected behavior

WebRTC stream sent by DJI Mini 3 Pro should not cause trouble either on OvenSpace Demo neither on our Premise OvenMediaEngine server.

I tested on Both FF and Chrome and had the issue.

Changing the rtmp target stream from (our ome)/(the demo ome) to SRS did not show any pb

Logs

Look for the app/1581F4XFC23930078AQ5 if you have interesting logs

Server (please complete the following information):
_ome_logs (9).txt

I don't think it come from the config since it is easy to reproduce on OvenSpace Demo sandbox here: https://space.ovenplayer.com/

Player (please complete the following information):
I don't think it come from the config since it is easy to reproduce on OvenSpace Demo sandbox here: https://space.ovenplayer.com/

Additional context

Does not produce if I stream directly from my phone for instance to OME, meaning there is sthing in the produced stream from DJI that OvenMediaEngine do not like; but that is OK for SRS

[antonymarion]

_ome_logs (9).txt

[antonymarion]

seems to be similar to #1691, but this time it is on both FF and Chrome and I do not see why DJI produced stream would have b frame here

[dimiden]

@antonymarion
For an accurate diagnosis, it would be helpful to dump the RTMP packets and then conduct the test.
Would it be possible to stream to my OME? If so, please let me know, and I’ll send you the RTMP address.

[antonymarion]

No worries, thks for your support

[dimiden]

I identified the cause and was in the process of fixing it when another issue was anticipated, so we are currently looking into it.
@Keukhan will follow up on the progress.

[antonymarion]

Great !

Curious to know what was causing this 🙂

[antonymarion]

Any news @Keukhan ? Thks

[Keukhan]

@antonymarion

DJI 3 PRO sends RTMP packets in a format that OvenMediaEngine does not support yet. The NAL type needed to build a frame should be in one packet, but it is split into different packets.

[OBS]

[11-18 16:29:33.344] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(3837) DTS(3837) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(20855)
[11-18 16:29:33.344] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 8
[11-18 16:29:33.344] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 1, Size: 8829
[11-18 16:29:33.344] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 12, Size: 12006
[11-18 16:29:33.387] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(3870) DTS(3870) Duration(-1) Flag(Key) BitstreamFormat(AVCC) PacketType(NALU) DataLength(63025)
[11-18 16:29:33.387] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 11
[11-18 16:29:33.387] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 8
[11-18 16:29:33.387] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 5, Size: 62994
[11-18 16:29:33.408] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(3903) DTS(3903) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(5295)
[11-18 16:29:33.408] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 8
[11-18 16:29:33.408] W [InboundWorker:2317147] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 1, Size: 5279
 

[DJI]

[11-18 16:42:07.755] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5008) DTS(5008) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(56) 
[11-18 16:42:07.755] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 52, Pts: 5008
[11-18 16:42:07.755] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5008) DTS(5008) Duration(-1) Flag(Key) BitstreamFormat(AVCC) PacketType(SEQUENCE_HEADER) DataLength(32) 
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5008) DTS(5008) Duration(-1) Flag(Key) BitstreamFormat(AVCC) PacketType(NALU) DataLength(8368) 
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 5, Size: 8364, Pts: 5008
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5038) DTS(5038) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(56) 
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 52, Pts: 5038
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5038) DTS(5038) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(3456) 
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 1, Size: 3452, Pts: 5038
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5068) DTS(5068) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(56) 
[11-18 16:42:07.845] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 6, Size: 52, Pts: 5068
[11-18 16:42:07.935] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:1211 | MSID(0) TrackID(0) PTS(5068) DTS(5068) Duration(-1) Flag(NoFlag) BitstreamFormat(AVCC) PacketType(NALU) DataLength(2384) 
[11-18 16:42:07.935] W [InboundWorker:2338558] MediaRouter | mediarouter_stream.cpp:210  | NALU Type: 1, Size: 2380, Pts: 5068

Unfortunately, it seems difficult to patch this issue quickly. I will move it to the issue tab for tracking. We need to make a plan and work on improving it.

If you only want playback without using file recording or live transcoding, comment out the following two lines of code.

OvenMediaEngine/src/projects/mediarouter/mediarouter_stream.cpp

Line 1222 in 2ec8124

media_packet->SetPts(pop_media_packet->GetPts() + 1);

Thanks.

[Keukhan]

Moved to issues tab
#1740