FFmpeg: EncodingFormatContext: return error code from open functions


introduce return values for openAVIO/openAVIOWithQFile, so that error
handling does not have to be implemented by observing side effects.

Pick-to: 6.12
Change-Id: I363bdf87412b522a0a4546bf8c69337227870954
Reviewed-by: Artem Dyomin <artem.dyomin@qt.io>
Reviewed-by: Tim Blechmann <tim.blechmann@qt.io>
commitc771c0e80083d54cf4ee39a1562f3d72a2ac568f
parente069291097c0228a31fd88a556fca9944e1efc27
authorTim Blechmann <tim.blechmann@qt.io>
committerTim Blechmann <tim.blechmann@qt.io>
commit timeSat, 12 Sep 2026 00:35:34 +0000