[Bug 795770] New: gstreamer-vaapi hangs when decoding a defect stream

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

Bug ID: 795770
Summary: gstreamer-vaapi hangs when decoding a defect stream
Classification: Platform
Product: GStreamer
Version: 1.14.0
OS: Linux
Status: NEW
Severity: normal
Priority: Normal
Component: gstreamer-vaapi
Assignee: gstreamer-***@lists.freedesktop.org
Reporter: ***@barco.com
QA Contact: gstreamer-***@lists.freedesktop.org
CC: ***@gmail.com, ***@igalia.com
GNOME version: ---

If a defective stream is decoded by gstreamer with vaapi, the pipeline hangs
and can't be stopped anymore with setting the pipeline state to GST_STATE_NULL.
This call will block forever.

A pcap stream to reproduce this can be found here:
https://barcozone-my.sharepoint.com/:u:/g/personal/thomas_scheuermann_barco_com/EQ8TkhCtzEpFoc3RkFzcpBoBZTxhPF1xERHu6XwFhMwBpQ?e=NhTqE0

The pcap file can be played with
sudo tcpreplay-edit -l 0 -i <network interface> --pnat=172.23.0.26:<local
address>,172.20.51.163:<remote address> --enet-dmac=<remote mac> gstlock2.pcap

The pipeline can be started the following way:
gst-launch-1.0 udpsrc uri="udp://0.0.0.0:34338" !
application/x-rtp,encoding-name=H264 ! rtph264depay ! h264parse ! vaapih264dec
! vaapisink

The pipeline doesn't hang if avdec_h264 is used.

Regards,
Thomas

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

Víctor Manuel Jáquez Leal <***@igalia.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |NEEDINFO

--- Comment #1 from Víctor Manuel Jáquez Leal <***@igalia.com> ---
Thanks for reporting this.

I have troubles replaying the pcap file. Could you upload a log file
GST_DEBUG=vaapi*:5 ??

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #2 from Thomas Scheuermann <***@barco.com> ---
Created attachment 371773
--> https://bugzilla.gnome.org/attachment.cgi?id=371773&action=edit
Error log with GST_DEBUG=vaapi*:5

This is the log file with stderr and stdout for GST_DEBUG=vaapi*:5.

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #3 from Víctor Manuel Jáquez Leal <***@igalia.com> ---
I don't see any strange in the logs.

What happens if you add vaapispostproc after the decoder or use vaapidecodebin
(which is a bin of decoder + queue + postproc)???

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #5 from Thomas Scheuermann <***@barco.com> ---
Which trouble do you have replaying the pcap file?

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #4 from Thomas Scheuermann <***@barco.com> ---
At the end of the log there is the line
0:00:10.761486320 17388 0x55587b219c00 DEBUG vaapi
gstvaapidecoder_h264.c:1859:parse_slice: parse slice
After this line nothing happened anymore.
Then I pressed CTRL-C
After this it is tried to stop the pipeline, but this will then hang also.

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

Hyunjun Ko <***@igalia.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@igalia.com

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #6 from Víctor Manuel Jáquez Leal <***@igalia.com> ---
(In reply to Thomas Scheuermann from comment #5)

Post by "GStreamer" (GNOME Bugzilla)
Which trouble do you have replaying the pcap file?

Sorry for the delay.

My main question is how to play it. Do I need a second computer to replay it?

I tried in a single computer I and didn't receive any data.

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #7 from Thomas Scheuermann <***@barco.com> ---
Yes, I use two computers. On one I do the replay and the decoding on the other.
I think it only works with two computers.

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

Víctor Manuel Jáquez Leal <***@igalia.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
Status|NEEDINFO |NEW

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

Víctor Manuel Jáquez Leal <***@igalia.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
Summary|gstreamer-vaapi hangs when |vaapih264dec: hangs when
|decoding a defect stream |decoding a defect stream

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #8 from Thomas Scheuermann <***@barco.com> ---
Could you reproduce it with two computers?

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

--- Comment #9 from Víctor Manuel Jáquez Leal <***@igalia.com> ---
Thanks for the ping.

Yes. I can reproduce the issue. As matter of fact I could dump a h264 raw file
with the stream[1] and the issue is still reproducible.

Even ffmpeg complains about the POC "co located POCs unavailable"

If I understand correctly, the stream has a large GOP with a lot of B frames,
depending on a non-existing I frame, thus the DPB grows and exhaust the
available VA surfaces.

1. https://www.ceyusa.com/media/bug795770.h264
(I can remove it if you wish).

["GStreamer" (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=795770

GStreamer system administrator <***@gstreamer.net> changed:

What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution|--- |OBSOLETE

--- Comment #10 from GStreamer system administrator <***@gstreamer.net> ---
-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been
closed from further activity.

You can subscribe and participate further through the new bug through this link
to our GitLab instance:
https://gitlab.freedesktop.org/gstreamer/gstreamer-vaapi/issues/94.