FFmpeg: pixel format scoring - cleanups


* move prohibitedFormats checks out of scroe function
* move some helpers out
* remove dead tracing comment
* use more direct naming `scoreTargetSwFormat`
* use anonymous namespace

Pick-to: 6.12
Change-Id: Ie7c75a55d198198142c5a5ad5c22dd23b8361b74
Reviewed-by: Nils Petter Skålerud <nils.petter.skalerud@qt.io>
commitd7f9a66c45580d8c4ddf6fe2cfd3952a135b49da
parentb8dfb5cdb84515bd7dff739eb2ced23f89ee2d64
authorTim Blechmann <tim.blechmann@qt.io>
committerTim Blechmann <tim.blechmann@qt.io>
commit timeWed, 12 Aug 2026 09:26:30 +0000