FLAC decoder testbench: Difference between revisions

From Hydrogenaudio Knowledgebase
VisualWikitext
m (Update rockbox)
(Thanks, fixed)
 
(37 intermediate revisions by 4 users not shown)
Line 1: Line 1:
To further the use and development of [[Free Lossless Audio Codec|FLAC]], a testbench containing files with different parameters was constructed. The testbench consists of 63 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users.
To further the use and development of [[Free Lossless Audio Codec|FLAC]], a testbench containing files with different parameters was constructed. The testbench consists of 64 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users.


The testbench can be [https://drive.google.com/file/d/1mQ1UV-hBQERD6dqcQRFtpMme9-gCvhod/view?usp=sharing downloaded here (revision 6)] and [https://github.com/ietf-wg-cellar/flac-test-files is maintained here].  It is licensed under [https://creativecommons.org/publicdomain/zero/1.0/ CC0 1.0].
The testbench can be [https://drive.google.com/file/d/1ECjkAyqV56xd9IZV-6zccG1Y-iE_hDMj/view?usp=sharing downloaded here (revision 7)] and [https://github.com/ietf-wg-cellar/flac-test-files is maintained here].  It is licensed under [https://creativecommons.org/publicdomain/zero/1.0/ CC0 1.0].


Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the [https://github.com/ietf-wg-cellar/flac-test-files/blob/main/subset/README.txt readme.txt file].  
Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the [https://github.com/ietf-wg-cellar/flac-test-files/blob/main/subset/README.txt readme.txt file]. Revision 7 replaces file 63 (which was faulty in revision 6) and adds file 64.


{| class="wikitable" cellspacing="2"
{| class="wikitable" cellspacing="2"
Line 11: Line 11:
! colspan="2" | Multichannel
! colspan="2" | Multichannel
! colspan="3" | Metadata
! colspan="3" | Metadata
! colspan="2" | Various
! colspan="3" | Various
!
!
|-
|-
Line 32: Line 32:
! Mono
! Mono
! Overfl.
! Overfl.
! Zero esc.
! Remarks
! Remarks
|-
|-
Line 52: Line 53:
| 60
| 60
| 61-63
| 61-63
| 64
|-
! Albrecht DR 460 C
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Slightly distorts 34567Hz file (sizzling sound)}}
| style="background: orange;" | {{tooltip|Fails|Very low volume on 12 bps file}}
| style="background: lime;"  | Plays
| style="background: yellow;" colspan="5" | {{tooltip|Skips|Skips all high-res files}}
| style="background: orange;" | {{tooltip|Fails|Skips 3, 4, 5 channel files, plays back 6, 7 and 8 channel files at high speed (chipmunk audio)}}
| style="background: yellow;" | Skips
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Skips extremely large seektable, plays silence on other large metadata blocks, plays large cuesheet and repeating vorbiscomment fine}}
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips with delay of about 10 seconds}}
| style="background: yellow;" | {{tooltip|Fails|Skips all three files, with a delay of about 10 seconds for the 16-bit file}}
| style="background: yellow;" | {{tooltip|Skips|Skips with delay of about 10 seconds}}
|
|-
|-
! Android
! Android
Line 64: Line 83:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|No sound on 20 bit file}}
| style="background: orange;" | {{tooltip|Fails|No sound on 20 bit file}}
| style="background: orange;" | {{tooltip|Fails|Skips 3.0, 4.0, 5.0 and 6.1, mutilated audio on 7.1}}
| style="background: yellow;" | {{tooltip|Skips|Skips 3.0, 4.0, 5.0 and 6.1}}
| style="background: yellow;" | {{tooltip|Skips|File skipped}}
| style="background: yellow;" | {{tooltip|Skips|File skipped}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| style="background: lime;"  | Plays
| -
| style="background: orange;" | {{tooltip|Fails|No sound on 20 bit file}}
| class="mw-collapsible mw-collapsed" | Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5
| style="background: orange;" | {{tooltip|Fails|Short bursts of static}}
| class="mw-collapsible mw-collapsed" | Android 13 with Google Play updates of 1st of Febuary 2023 on Samsung XCover 5
|-
! Chromecast
| style="background: orange;" | {{tooltip|Fails|Heavy stutter with blocksize 16}}
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Mangles non-standard samplerates}}
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Never starts playing on old format blocksize}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Mangles non-standard samplerates}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips file with avif embedded picture}}
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips file with 24-bit overflow check}}
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7
|-
|-
! Citroën DS5
! Citroën DS5
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate, plays 22050Hz}}
| style="background: orange;" | {{tooltip|Fails|Extreme distortion on playback}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" colspan="7" | {{tooltip|Skips|Skips all high-res and multichannel files}}
| style="background: orange;" | {{tooltip|Fails|Extreme distortion on playback of 8-bit file, 12-bit file is played back too soft}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"   | {{tooltip|Hangs|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}}
| style="background: orange;" | {{tooltip|Fails|20-bit file is played back too soft}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
|
|-
! Chromecast
| style="background: orange;" | Fails
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | Fails
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | Fails
| style="background: orange;"   | {{tooltip|Fails|File with large application metadata block results playback of part of another file before playing the proper audio}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | Fails
| style="background: orange;" | Fails
| style="background: orange;" | Fails
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" colspan="2" | Rejects
| style="background: lime;" | {{tooltip|Plays|20-bit file is played back too soft like file 37, but is otherwise OK}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | Reboots
| class="mw-collapsible mw-collapsed" | Tested with system firmware 7.1.5-r1, model year 2018, testbench revision 7
| style="background: yellow;" | Rejects
| -
| -
| class="mw-collapsible mw-collapsed" | Heavy stutter with blocksize 16. Mangles non-standard samplerates. Doesn't start playing on old variable blocksize format, blocksizes 16384 and 13456, predictor order 32, 384kHz. Skips multichannel and image/avif. Crashes on file with 1000x repeating VORBISCOMMENT
|-
|-
! Cowon iAudio 7
! Cowon iAudio 7
| style="background: orange;" | Fails
| style="background: red;"   | {{tooltip|Freezes|Freezes on blocksizes 254 and 725; skips file with blocksize 1937}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | Fails
| style="background: orange;" | {{tooltip|Fails|35467Hz and 39kHz are speeded up; 22050 plays at correct speed}}
| style="background: yellow;" | Rejects
| style="background: yellow;" | {{tooltip|Rejects|All files with bitdepth other than 16 are skipped}}
| style="background: yellow;" | {{tooltip|Rejects|All files with variable block size are skipped}}
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
Line 116: Line 146:
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| style="background: red;"   | {{tooltip|Freezes|3.0 plays as silence, others 16/44 multichannel files make freeze}}
| style="background: red;" colspan="2" | Freezes
| style="background: yellow;" | {{tooltip|Rejects|File is skipped}}
| -
| -
| -
| -
| -
| style="background: lime;"  | Plays
| -
| style="background: lime;"  | Plays
| -
| style="background: yellow;" | {{tooltip|Rejects|File 61 plays normally. Files 62 and 63 are skipped because device doesn't support FLAC with bitdepth other than 16 at all.}}
| class="mw-collapsible mw-collapsed" | Freezes on blocksizes 254, 725; skips file with blocksize 1937. 38457Hz and 41kHz are speeded up; 22050 Plays. All files with bitdepth other than 16 are skipped. Files with variable block size are skipped. 3.0 plays as silence, others 16/44 MCH files make freeze.
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Device doesn't support FLAC with bitdepth other than 16 and samplerate higher than 44.1 kHz. So actual features of files 45-54 and 62-63 cannot be tested. File 55 plays, but takes long time to start.
|-
|-
! Ford SYNC
! Ford SYNC
Line 141: Line 172:
| style="background: yellow;"    | {{tooltip|Skips|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}}
| style="background: yellow;"    | {{tooltip|Skips|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| -
| -
Line 160: Line 192:
| style="background: red;"    | Reboots
| style="background: red;"    | Reboots
| style="background: yellow;" | Rejects
| style="background: yellow;" | Rejects
| -
| -
| -
| -
| -
Line 180: Line 213:
| style="background: red;"    | Reboots
| style="background: red;"    | Reboots
| style="background: lime;" | Plays
| style="background: lime;" | Plays
| -
| -
| -
| -
| -
Line 195: Line 229:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|20 bit and 24 bit files are played back with shorts bursts of loud static}}
| style="background: orange;" | {{tooltip|Fails|20 bit and 24 bit files are played back with shorts bursts of loud static}}
| -
| class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version V5.15, dated 2020-04-24
| class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version V5.15, dated 2020-04-24
|-
! Mazda Connect
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|After playing file 27, the unit does not automatically continue playback of the next track}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Tested with revision 7, CX-90 MY2024
|-
|-
! Onkyo TX-NR686
! Onkyo TX-NR686
Line 210: Line 266:
| style="background: yellow;" colspan="2" | {{tooltip|Rejects|Does not play 4.0, 5.1 and 7.1 files but does play 5.0 and 6.1 as stereo and 3.0 as 3.1}}
| style="background: yellow;" colspan="2" | {{tooltip|Rejects|Does not play 4.0, 5.1 and 7.1 files but does play 5.0 and 6.1 as stereo and 3.0 as 3.1}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Reboots|Crashes on file with 1000x repeating VORBISCOMMENT}}
| style="background: red;"    | {{tooltip|Unresp.|Becomes unresponsive on file with 1000x repeating VORBISCOMMENT}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version 1071-2000-1070-0011.
| class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version 1071-4000-1070-0011.
|-
|-
! Panasonic TX-60CX750E
! Panasonic TX-60CX750E
Line 234: Line 291:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| class="mw-collapsible mw-collapsed" | Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6
| class="mw-collapsible mw-collapsed" | Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6
|-
|-
Line 253: Line 311:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}}
| style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}}
| -
| class="mw-collapsible mw-collapsed" | Firmware v1.08, testbench revision 6
| class="mw-collapsible mw-collapsed" | Firmware v1.08, testbench revision 6
|-
|-
Line 265: Line 324:
| style="background: yellow;" | {{tooltip|Other|Plays, but takes about a minute time to start playing. During this wait, track can be skipped, unit does not become unresponsive}}
| style="background: yellow;" | {{tooltip|Other|Plays, but takes about a minute time to start playing. During this wait, track can be skipped, unit does not become unresponsive}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| -
| -
Line 286: Line 346:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Plays 20-bit and 24-bit file but with loud bursts of static}}
| style="background: orange;" | {{tooltip|Fails|Plays 20-bit and 24-bit file but with loud bursts of static}}
| class="mw-collapsible mw-collapsed" |  Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 6
| style="background: orange;" | {{tooltip|Fails|PLays, but with short ticks}}
| class="mw-collapsible mw-collapsed" |  Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 7
|-
! Samsung F5100WWB
| style="background: red;"    | {{tooltip|Crashes|Freezes on blocksizes 254, 725 and 1000, crashes on blocksize 1937, skips blocksize 16}}
| style="background: orange;" | {{tooltip|Fails|Garbled audio when playing file with LPC with qlp precision of 2}}
| style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz}}
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Freezes|Freezes on variable blocksize files with non-standard blocksizes, stutters on variable blocksize files with standard blocksizes, rejects CUETools and old format variable blocksize file}}
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Skips|Skips non-standard blocksize (13456)}}
| style="background: orange;" | {{tooltip|Fails|Mangles file with RICE2 partitions with escape codes}}
| style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz. Mangles 192kHz with 32th order predictors}}
| style="background: lime;"  | Plays
| style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on files with more than 6 channels}}
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Freezes|Becomes unresponsive on file with 1000x repeating vorbis comment}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}}
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7
|-
|-
! Sony BDP-1700
! Sony BDP-1700
Line 305: Line 386:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}}
| style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}}
| -
| class="mw-collapsible mw-collapsed" | Firmware m30.R.0527, testbench revision 6
| class="mw-collapsible mw-collapsed" | Firmware m30.R.0527, testbench revision 6
|-
|-
! colspan="16" | Software players
! Toyota Entune 3.0
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate, plays 22050Hz}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate (here 134560 and 384000)}}
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips 6.1 and 7.1}}
| style="background: yellow;" | Skips
| style="background: yellow;" | {{tooltip|Skips|Skips unknown minimum/maximum framesize}}
| style="background: yellow;" | {{tooltip|Skips|Skips 51 and 54 with abnormal VORBISCOMMENT}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7
|-
|-
! Foobar 2000
! colspan="20" | Software players
|-
! AIMP 5.03 build 2398 (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 323: Line 427:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;" | {{tooltip|Plays|version 1.6.8 plays. 1.6.7: Error message: Unable to open item for playback (bad allocation)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Foobar2000 version 1.6.8 with testbench revision 5, version 1.6.11 with revision 6 <i>updates</i> only.
| style="background: orange;" | {{tooltip|Fails|Stuttering playback}}
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
|-
|-
! VLC
! Album Player 2.114 (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Gives out error on 12 bit. Only noise on 8 bit.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 6.1 and 7.1}}
| style="background: yellow;" | {{tooltip|Rejects|Gives out error}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Unable to play old-style variable blocksize}}
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
|-
! Amarok (Windows)
| style="background: orange;"   | {{tooltip|Fails|Plays silence on blocksizes 16, 254, 725, 1000, 1937, 2304. (Could be provoked to play a split second of one.)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"  | {{tooltip|Crashes|Crashes on 8 bits. And plays silence on 12 bits}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"  | {{tooltip|Fails|Silence on blocksize 13456}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Crashes|Crashes occasionally on files with extremely large VORBISCOMMENT}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | VLC 3.0.16 on testbench revision 5 <br>VLC 3.0.17.4 on files 60 to 63.
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits, like on number 37}}
| -
| class="mw-collapsible mw-collapsed" | Amarok version 2.8.0 with testbench revision 5 and 60-63
|-
|-
! Winamp 5.8
! Cog
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Versions before 1630 will reject the 12 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Freezes|Freezes on 12 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"   | {{tooltip|Freezes|Freezes on 384kHz}}
| style="background: lime;"   | {{tooltip|Plays|Versions before 1630 will reject this 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as test 43 incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as this test incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on 3.0, 5.0, 6.1 and 7.1 files}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  |{{tooltip|Plays|Versions before 1630 will reject the 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| -
| -
| class="mw-collapsible mw-collapsed" | version 2169 (2169-gbf54c452) with testbench revision 6
|-
! DeaDBeeF 1.9.3 (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
|    colspan="2" | {{tooltip|(not tested - )|Could not test multichannel}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | deadbeef 1.9.3 [static] [portable].  Testbench revision 7
|-
! Exaile (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"    | {{tooltip|Fails|Version 4.1.2 beta1: File 25 Flake smaller blocksize is played back noisy. File 27 old format mutes after a split second. Version 4.1.1: Skips all variable blocksize files, except: stops upon the old format flake 0.11 (but can resume playback on different file)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| class="mw-collapsible mw-collapsed" | Winamp 5.8 build 3660, testbench revision 5
| class="mw-collapsible mw-collapsed" | First tested version 4.1.1  (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
|-
! ffplay N-108161-gaaf6d85283-20220916 (Windows)
| style="background: orange;"  | {{tooltip|Fails|Wrong speed on blocksize 16}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|But output channel layout for 6.1 is incorrect: FL,FR,FC,LFE,BL,BR,BC instead of FL,FR,FC,LFE,BC,SL,SR}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Takes about 30 seconds before starts to play file 55}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7. File 03 still broken in versions N-109368-gcc11afe502-20221206, 6.1-essentials_build-www.gyan.dev and 7.0-essentials_build-www.gyan.dev
|-
! foobar2000 1.6.14 and 2.0 beta 7 [x86]
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Since version 1.6.8}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;" | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7
|-
|-
! Windows Media Player
! GoneMAD (Android)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 378: Line 589:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | Crashes
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects all}}
| style="background: red;"   | {{tooltip|Hangs|Hangs on 55. Also unresponsible UI on 51, but plays.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| -
| class="mw-collapsible mw-collapsed" | Tested version 12.0.19041.1288 on testbench revision 5
| -
| class="mw-collapsible mw-collapsed" | testbench revision 5
|-
|-
! mpv
! JRiver Media Center (Windows 64; portable)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|lowers volume on 12 bit and 8 bit}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 397: Line 610:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|lowers volume on 20 bit}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 402: Line 616:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Hangs|Hangs on files with 1000x repeating vorbiscomments}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|lowers volume on 20 bit}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
| class="mw-collapsible mw-collapsed" | Windows version 31.0.84 64-bit with testbench version 7.1. (Version 28.0.88 would reject number 54.)
| class="mw-collapsible mw-collapsed" | mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63
|-
|-
! Mediamonkey 5
! Mediamonkey 5
Line 412: Line 625:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Crashes|Crashes on 12-bit file}}
| style="background: yellow;"    | {{tooltip|Skips|5.0.4 skips 12-bit file. (Old 5.0.1 crashed.)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 419: Line 632:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Silence|Plays silence on 20-bit file.}}
| style="background: orange;" | {{tooltip|Silence|Plays silence on 20-bit file.}}
| style="background: orange;" | {{tooltip|Breaks|Only plays first 2 seconds of all spoken multichannel files}}
| style="background: orange;" | {{tooltip|Fails|Only plays first 2 seconds of all spoken multichannel files}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Fixed in 5.0.4. Version 5.0.1 got unresponsive when (and after) playing files with 1000x repeating vorbiscomments}}
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Only plays first 2 seconds}}
| style="background: red;"    | {{tooltip|Freezes|File 62 most often skipped, but freeze (to be killed with Task Manager) was provoked. Files 61/63 play first 2 seconds)}}
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Updated with version 5.0.4.2690 testing files 60-64 and the ones 5.0.1.2433 failed (22) / froze (54-55) upon testing revision 5.
|-
! MacOS
| style="background: yellow;" | {{tooltip|Skips|Skips blocksize 16 file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"   | {{tooltip|Unresp.|GUI becomes unresponsive on (and after) playing files with 1000x repeating vorbiscomments}}
| style="background: yellow;" | {{tooltip|Skips|Skips 8-bit and 12-bit file}}
| style="background: yellow;" | {{tooltip|Skips|Skips all variable blocksize files}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| style="background: lime;"  | Plays
| -
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Version 5.0.1.2433 with testbench revision 5
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7, tested with Quicktime and Safari on MacOS 13
|-
|-
! Mplayer (Windows)
! Mplayer (Windows)
Line 446: Line 681:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
| class="mw-collapsible mw-collapsed" | Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | SMPlayer-bundled version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-64
|-
|-
! ffplay (Windows)
! mpv
| style="background: orange;"  | {{tooltip|Fails|Wrong speed on blocksize 16}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 462: Line 702:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| class="mw-collapsible mw-collapsed" | Tested both mpv v0.38.0-633-ge509ec0a for Windows and v0.38.0-432-g112fa549be, testbench revision 7
| -
| class="mw-collapsible mw-collapsed" | version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5
|-
|-
! Spotify (Windows)
! MusicBee 3.4.8033 (Windows; portable)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips 12 bits per sample}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: yellow;"  | {{tooltip|Skips|Skips 20 bits}}
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"    | {{tooltip|Rejects|Does not index any of the 'extremely large' 48-52 & 55}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
| style="background: lime;" | Plays
| class="mw-collapsible mw-collapsed" | Testbench revision 7. Only tested on headphones, does left/right correctly on multichannel.
|-
|-
! JRiver Media Center
! Quod Libet (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|lowers volume on 12 bit and 8 bit}}
| style="background: lime;"  | Plays
| style="background: orange;"    | {{tooltip|Fails|Chirp sounds on old-format 0.11.  Other variable blocksize files makes player skip subsequent file(s) in the playlist.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 502: Line 743:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|rejects (with error message) extremely large VORBISCOMMENT. Still plays the all-combined 55.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| class="mw-collapsible mw-collapsed" | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
| class="mw-collapsible mw-collapsed" | version 28.0.88 64-bit with testbench revision 5
|-
|-
! Amarok (Windows)
! Resoniq 0.9.3 (portable, Windows)
| style="background: orange;"  | {{tooltip|Fails|Plays silence on blocksizes 16, 254, 725, 1000, 1937, 2304. (Could be provoked to play a split second of one.)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"  | {{tooltip|Crashes|Crashes on 8 bits. And plays silence on 12 bits}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"  | {{tooltip|Fails|Silence on blocksize 13456}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 524: Line 758:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"  |  {{tooltip|Fails?|Suspicious channel allocation on 6.1 and 7.1. Tested only on stereo set, but side-right not spoken even when side-left is.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits, like on number 37}}
| class="mw-collapsible mw-collapsed" | Amarok version 2.8.0 with testbench revision 5 and 60-63
|-
! Exaile (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"    | {{tooltip|Fails|Version 4.1.2 beta1: File 25 Flake smaller blocksize is played back noisy. File 27 old format mutes after a split second. Version 4.1.1: Skips all variable blocksize files, except: stops upon the old format flake 0.11 (but can resume playback on different file)}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;" | Plays
| class="mw-collapsible mw-collapsed" | Apparently uses FLAC 1.3.2. Testbench revision 7.
|-
! Spotify (Windows)
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Skips|Skips 12 bits per sample}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: yellow;"  | {{tooltip|Skips|Skips 20 bits}}
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"    | {{tooltip|Rejects|Does not index any of the 'extremely large' 48-52 & 55}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | First tested version 4.1.1  (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
| -
| class="mw-collapsible mw-collapsed" | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
|-
|-
! Quod Libet (Windows)
! VLC
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Unable to play old-style variable blocksize}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;"    | {{tooltip|Fails|Chirp sounds on old-format 0.11.  Other variable blocksize files makes player skip subsequent file(s) in the playlist.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Crashes|Crashes occasionally on files with extremely large VORBISCOMMENT}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
| class="mw-collapsible mw-collapsed" | VLC 3.0.16 on testbench revision 5 <br>VLC 3.0.17.4 on files 60 to 63.<br>VLC 3.0.16 on file 64
|-
|-
! Cog
! VUPlayer 4.15
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Versions before 1630 will reject the 12 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 578: Line 825:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | {{tooltip|Plays|Versions before 1630 will reject this 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as test 43 incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as this test incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  |{{tooltip|Plays|Versions before 1630 will reject the 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
| class="mw-collapsible mw-collapsed" | version 2169 (2169-gbf54c452) with testbench revision 6
|-
|-
! GoneMAD (Android)
! Winamp 5.8
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Freezes|Freezes on 12 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | {{tooltip|Freezes|Freezes on 384kHz}}
| style="background: lime;"  | Plays
| style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on 3.0, 5.0, 6.1 and 7.1 files}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| class="mw-collapsible mw-collapsed" | Winamp 5.8 build 3660, testbench revision 5
|-
! Windows Media Player
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 598: Line 861:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"    | Crashes
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: red;"   | {{tooltip|Hangs|Hangs on 55. Also unresponsible UI on 51, but plays.}}
| style="background: yellow;" | {{tooltip|Rejects|Rejects all}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| -
| -
| -
| -
| class="mw-collapsible mw-collapsed" | testbench revision 5
| -
| class="mw-collapsible mw-collapsed" | Tested version 12.0.19041.1288 on testbench revision 5
|-
|-
! VUPlayer
! XMPlay
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
Line 619: Line 891:
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | XMPlay 3.8.5.42 with FLAC decoder revision 14 tested with testbench revision 7.
|-
! colspan="20" | Digital Audio Workstations (DAW)
|-
! Adobe Audition
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6.
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: orange;" | {{tooltip|Fails|Imports silence on file with no total number of samples set}}
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: lime;"  | Plays
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
| style="background: lime;"  | Plays
| class="mw-collapsible mw-collapsed" | Adobe Audition 1.5 with http://www.vuplayer.com/audition.php plugin, tested with testbench revision 7.
 
|-}
|-}
|-}


Line 633: Line 923:
! colspan="2" | Table legend
! colspan="2" | Table legend
|-
|-
| style="background: lime;"  | Plays  || all files in this category are played as intended, without glitches, changes etc.
| style="background: lime;"  | Plays  || all files in this category are played as intended, without glitches, changes etc.; changed volume tolerated (but indicated)
|-
|-
| style="background: yellow;" | Rejects || One or more files are rejected by the player, either by skipping the file or mentioning a message like: "file not supported"
| style="background: yellow;" | Rejects || One or more files are rejected by the player, either by skipping the file or mentioning a message like: "file not supported"

Latest revision as of 06:52, 3 September 2024

To further the use and development of FLAC, a testbench containing files with different parameters was constructed. The testbench consists of 64 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users.

The testbench can be downloaded here (revision 7) and is maintained here. It is licensed under CC0 1.0.

Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the readme.txt file. Revision 7 replaces file 63 (which was faulty in revision 6) and adds file 64.

CDDA (44.1kHz/16-bit and less) High-res (96kHz/24-bit and more) Multichannel Metadata Various
Decoder Block­sizes Features Sample­rates Bit­depths Var. bl.size General Block­size Features Sample­rates Bit­depths General Features Missing Extreme MIME Mono Overfl. Zero esc. Remarks
Files in test set 1-10 11-18 19-21 22-23 24-27 28 29-30 31-32, 34 33-36 37 38-43 44 45-47 48-55 56-59 60 61-63 64
Albrecht DR 460 C Plays Plays Fails Fails Plays Skips Fails Skips Plays Fails Plays Skips Fails Skips
Android Fails Plays Plays Plays Skips Plays Plays Plays Plays Fails Skips Skips Plays Plays Plays Plays Fails Fails Android 13 with Google Play updates of 1st of Febuary 2023 on Samsung XCover 5
Chromecast Fails Plays Fails Plays Fails Plays Plays Plays Fails Plays Plays Plays Plays Plays Skips Plays Skips Plays Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7
Citroën DS5 Plays Plays Plays Fails Plays Plays Plays Plays Plays Fails Plays Plays Plays Fails Plays Plays Plays Plays Tested with system firmware 7.1.5-r1, model year 2018, testbench revision 7
Cowon iAudio 7 Freezes Plays Fails Rejects Rejects Rejects Rejects Rejects Rejects Rejects Freezes Rejects - - Plays Plays Rejects Plays Device doesn't support FLAC with bitdepth other than 16 and samplerate higher than 44.1 kHz. So actual features of files 45-54 and 62-63 cannot be tested. File 55 plays, but takes long time to start.
Ford SYNC Plays Plays Plays Skips Plays Plays Plays Plays Plays Skips Plays Plays Plays Skips Plays - - - Tested with revision 5, SYNC version 3.3, build 18201_PRODUCT
JVC KD-R871BT Fails Plays Fails Plays Rejects Plays Freezes Reboots Fails Rejects Rejects Rejects Reboots Rejects - - - Heavy stutter with blocksize 16. Stretches non-standard samplerates. Samplerates above 96kHz, variable blocksize files and multichannel files 'not supported'. Freezes on blocksize 16384 and 13456. 192kHz is played back very slow. Skips all multichannel, files with cover image, extreme metadata. Reboot loop on extreme large VORBISCOMMENT
Kenwood KMM-BT304 Fails Plays Rejects Plays Rejects Plays Rejects Rejects Rejects Plays Rejects Rejects Plays Reboots Plays - - - File 03 plays extremely noisily, barely recognizable. File 51 produces a "NO DEVICE" error and a reboot. File 54 produces a reboot with no message. These files produce a "NA FILE" error and the player skips to the next: 19 21 24 25 26 27 29 30 31 34 35 36 38 39 40 41 42 43 44 45 46 48 55. (firmware: te1706k.krm from 2020-03-05)
Lenco Xemio-240 Plays Plays Freezes Plays Rejects Plays Plays Plays Plays Fails - Tested with revision 6, firmware version V5.15, dated 2020-04-24
Mazda Connect Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Tested with revision 7, CX-90 MY2024
Onkyo TX-NR686 Fails Plays Rejects Plays Rejects Plays Plays Plays Rejects Plays Rejects Plays Unresp. Plays Plays Plays Plays Tested with revision 6, firmware version 1071-4000-1070-0011.
Panasonic TX-60CX750E Plays Plays Fails Plays Plays Plays Plays Plays Fails Plays Plays Fails Plays Fails Plays Plays Plays - Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6
Pioneer BDP-150 Freezes Fails Fails Plays Freezes Plays Freezes Fails Fails Plays Freezes Freezes Freezes Plays Plays Fails - Firmware v1.08, testbench revision 6
Pioneer DEH-1900UB Skips Plays Skips Skips Skips Skips Plays Other Plays - - - Testbench revision 5
Rockbox Plays Plays Plays Plays Plays Plays Skips Skips Plays Plays Freezes Freezes Fails Plays Plays Fails Fails Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 7
Samsung F5100WWB Crashes Fails Fails Plays Freezes Plays Skips Fails Fails Plays Freezes Plays Freezes Plays Plays Fails Plays Testbench revision 7
Sony BDP-1700 Freezes Fails Fails Plays Freezes Plays Freezes Fails Fails Plays Freezes Skips Plays Plays Plays Fails - Firmware m30.R.0527, testbench revision 6
Toyota Entune 3.0 Plays Plays Skips Plays Plays Plays Plays Plays Skips Plays Skips Skips Skips Skips Plays Plays Plays Plays Testbench revision 7
Software players
AIMP 5.03 build 2398 (Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails Testbench revision 7.
Album Player 2.114 (Windows) Plays Plays Plays Fails Plays Plays Plays Plays Plays Rejects Rejects Rejects Plays Plays Plays Plays Rejects Plays Testbench revision 7.
Amarok (Windows) Fails Plays Plays Crashes Plays Plays Fails Plays Skips Fails Plays Plays Plays Plays Plays Plays Fails - Amarok version 2.8.0 with testbench revision 5 and 60-63
Cog Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays - version 2169 (2169-gbf54c452) with testbench revision 6
DeaDBeeF 1.9.3 (Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays (not tested - ) Plays Plays Plays Plays Plays Plays Plays deadbeef 1.9.3 [static] [portable]. Testbench revision 7
Exaile (Windows) Plays Plays Plays Plays Fails Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays - First tested version 4.1.1 (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
ffplay N-108161-gaaf6d85283-20220916 (Windows) Fails Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7. File 03 still broken in versions N-109368-gcc11afe502-20221206, 6.1-essentials_build-www.gyan.dev and 7.0-essentials_build-www.gyan.dev
foobar2000 1.6.14 and 2.0 beta 7 [x86] Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7
GoneMAD (Android) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Crashes Plays Hangs Plays - - - testbench revision 5
JRiver Media Center (Windows 64; portable) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Windows version 31.0.84 64-bit with testbench version 7.1. (Version 28.0.88 would reject number 54.)
Mediamonkey 5 Plays Plays Plays Skips Plays Plays Plays Plays Plays Silence Fails Plays Plays Plays Plays Fails Freezes Plays Updated with version 5.0.4.2690 testing files 60-64 and the ones 5.0.1.2433 failed (22) / froze (54-55) upon testing revision 5.
MacOS Skips Plays Plays Skips Skips Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7, tested with Quicktime and Safari on MacOS 13
Mplayer (Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails Plays Plays Plays Unresp. Plays Plays Fails Plays SMPlayer-bundled version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-64
mpv Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Tested both mpv v0.38.0-633-ge509ec0a for Windows and v0.38.0-432-g112fa549be, testbench revision 7
MusicBee 3.4.8033 (Windows; portable) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7. Only tested on headphones, does left/right correctly on multichannel.
Quod Libet (Windows) Plays Plays Plays Plays Fails Plays Plays Plays Skips Plays Plays Plays Plays Plays Plays Plays Plays - version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
Resoniq 0.9.3 (portable, Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails? Plays Plays Plays Plays Plays Plays Plays Apparently uses FLAC 1.3.2. Testbench revision 7.
Spotify (Windows) Plays Plays Plays Skips Plays Plays Plays Plays Skips Skips Skips (?) Skips (?) Plays Rejects Plays Plays Plays - Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
VLC Plays Plays Plays Plays Fails Plays Plays Plays Plays Plays Plays Plays Plays Crashes Plays Plays Plays Plays VLC 3.0.16 on testbench revision 5
VLC 3.0.17.4 on files 60 to 63.
VLC 3.0.16 on file 64
VUPlayer 4.15 Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7.
Winamp 5.8 Plays Plays Plays Freezes Plays Plays Plays Plays Freezes Plays Freezes Plays Plays Plays - - - Winamp 5.8 build 3660, testbench revision 5
Windows Media Player Plays Plays Plays Rejects Plays Plays Plays Plays Plays Rejects Plays Plays Plays Rejects Plays - - - Tested version 12.0.19041.1288 on testbench revision 5
XMPlay Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays XMPlay 3.8.5.42 with FLAC decoder revision 14 tested with testbench revision 7.
Digital Audio Workstations (DAW)
Adobe Audition Plays Plays Plays Rejects Plays Plays Plays Plays Plays Rejects Plays Plays Fails Plays Plays Plays Rejects Plays Adobe Audition 1.5 with http://www.vuplayer.com/audition.php plugin, tested with testbench revision 7.
Table legend
Plays all files in this category are played as intended, without glitches, changes etc.; changed volume tolerated (but indicated)
Rejects One or more files are rejected by the player, either by skipping the file or mentioning a message like: "file not supported"
Fails One or more files are not played back as intended, for example by stuttering, garbling or playing at incorrect speed, or by never starting playing (though not skipping, freezing or rebooting)
Freezes On one or more files, the player crashes on decoding, leaving the unit inoperable until reboot, or the unit reboots by itself
The order of precedence is from bottom to top, so if one file freezes the player, one file is rejected and the other play fine, the table reads 'Freezes' for that category.
For the metadata tests, the (absence of) rendering of the metadata is not a criterium, simply whether its presence is an obstacle to playing
Retrieved from "https://wiki.hydrogenaud.io/index.php?title=FLAC_decoder_testbench&oldid=38196"