Difference between revisions of "FLAC decoder testbench"
(Added mpv) |
(Update chromecast entry (which has improved), update testbench to r7 and add column for file 64) |
||
(44 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
− | To further the use and development of [[Free Lossless Audio Codec|FLAC]], a testbench containing files with different parameters was constructed. The testbench consists of | + | To further the use and development of [[Free Lossless Audio Codec|FLAC]], a testbench containing files with different parameters was constructed. The testbench consists of 63 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users. |
− | + | The testbench can be [https://drive.google.com/file/d/1ECjkAyqV56xd9IZV-6zccG1Y-iE_hDMj/view?usp=sharing downloaded here (revision 7)] and [https://github.com/ietf-wg-cellar/flac-test-files is maintained here]. It is licensed under [https://creativecommons.org/publicdomain/zero/1.0/ CC0 1.0]. | |
− | + | Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the [https://github.com/ietf-wg-cellar/flac-test-files/blob/main/subset/README.txt readme.txt file]. Revision 7 replaces file 63 (which was faulty in revision 6) and adds file 64. | |
{| class="wikitable" cellspacing="2" | {| class="wikitable" cellspacing="2" | ||
Line 11: | Line 11: | ||
! colspan="2" | Multichannel | ! colspan="2" | Multichannel | ||
! colspan="3" | Metadata | ! colspan="3" | Metadata | ||
+ | ! colspan="3" | Various | ||
! | ! | ||
|- | |- | ||
!'''Decoder''' | !'''Decoder''' | ||
− | ! Block­ | + | ! Block­sizes |
! Features | ! Features | ||
! Sample­rates | ! Sample­rates | ||
! Bit­depths | ! Bit­depths | ||
− | ! Variable blocksize | + | ! {{tooltip|Var. bl.size|Variable blocksize}} |
! General | ! General | ||
! Block­size | ! Block­size | ||
Line 24: | Line 25: | ||
! Sample­rates | ! Sample­rates | ||
! Bit­depths | ! Bit­depths | ||
− | ! | + | ! General |
! Features | ! Features | ||
! Missing | ! Missing | ||
! Extreme | ! Extreme | ||
! MIME | ! MIME | ||
+ | ! Mono | ||
+ | ! Overfl. | ||
+ | ! Zero esc. | ||
! Remarks | ! Remarks | ||
|- | |- | ||
Line 47: | Line 51: | ||
| 48-55 | | 48-55 | ||
| 56-59 | | 56-59 | ||
+ | | 60 | ||
+ | | 61-63 | ||
+ | | 64 | ||
+ | |- | ||
+ | ! Android | ||
+ | | style="background: orange;" | {{tooltip|Fails|Heavy stuttering on blocksize 16}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips all variable blocksize files}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|No sound on 20 bit file}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Skips 3.0, 4.0, 5.0 and 6.1, mutilated audio on 7.1}} | ||
+ | | style="background: yellow;" | {{tooltip|Skips|File skipped}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5 | ||
|- | |- | ||
! Citroën DS5 | ! Citroën DS5 | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Skips | + | | style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate, plays 22050Hz}} |
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Extreme distortion on playback}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" colspan="7" | Skips | + | | style="background: yellow;" colspan="7" | {{tooltip|Skips|Skips all high-res and multichannel files}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Hangs | + | | style="background: red;" | {{tooltip|Hangs|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | | + | | - |
+ | | - | ||
+ | | - | ||
+ | | | ||
|- | |- | ||
! Chromecast | ! Chromecast | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Heavy stutter with blocksize 16}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Mangles non-standard samplerates}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Never starts playing on old format blocksize}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | |||
− | |||
− | |||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | |||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: | + | | style="background: orange;" | {{tooltip|Fails|Mangles non-standard samplerates}} |
− | | style="background: yellow;" | | + | | style="background: lime;" | Plays |
− | | class="mw-collapsible mw-collapsed" | | + | | style="background: lime;" | Plays |
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips file with avif embedded picture}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips file with 24-bit overflow check}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | class="mw-collapsible mw-collapsed" | Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7 | ||
|- | |- | ||
! Cowon iAudio 7 | ! Cowon iAudio 7 | ||
Line 89: | Line 124: | ||
| style="background: yellow;" | Rejects | | style="background: yellow;" | Rejects | ||
| style="background: red;" colspan="2" | Freezes | | style="background: red;" colspan="2" | Freezes | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
| - | | - | ||
| - | | - | ||
| - | | - | ||
| class="mw-collapsible mw-collapsed" | Freezes on blocksizes 254, 725; skips file with blocksize 1937. 38457Hz and 41kHz are speeded up; 22050 Plays. All files with bitdepth other than 16 are skipped. Files with variable block size are skipped. 3.0 plays as silence, others 16/44 MCH files make freeze. | | class="mw-collapsible mw-collapsed" | Freezes on blocksizes 254, 725; skips file with blocksize 1937. 38457Hz and 41kHz are speeded up; 22050 Plays. All files with bitdepth other than 16 are skipped. Files with variable block size are skipped. 3.0 plays as silence, others 16/44 MCH files make freeze. | ||
+ | |- | ||
+ | ! Ford SYNC | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 12 bit per sample file}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 20 bit per sample file}} | ||
+ | | style="background: lime;" | {{tooltip|Plays|Only plays left and right channels, does not downmix}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Tested with revision 5, SYNC version 3.3, build 18201_PRODUCT | ||
|- | |- | ||
! JVC KD-R871BT | ! JVC KD-R871BT | ||
Line 102: | Line 161: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: red;" | Freezes | | style="background: red;" | Freezes | ||
− | | | + | | style="background: red;" | Reboots |
+ | | style="background: orange;" | Fails | ||
| style="background: yellow;" | Rejects | | style="background: yellow;" | Rejects | ||
− | |||
| style="background: yellow;" colspan="2" | Rejects | | style="background: yellow;" colspan="2" | Rejects | ||
+ | | style="background: yellow;" | Rejects | ||
+ | | style="background: red;" | Reboots | ||
+ | | style="background: yellow;" | Rejects | ||
| - | | - | ||
| - | | - | ||
| - | | - | ||
− | | class="mw-collapsible mw-collapsed" | Heavy stutter with blocksize 16. Stretches non-standard samplerates. Samplerates above 96kHz, variable blocksize files and multichannel files 'not supported'. Freezes on blocksize 16384 | + | | class="mw-collapsible mw-collapsed" | Heavy stutter with blocksize 16. Stretches non-standard samplerates. Samplerates above 96kHz, variable blocksize files and multichannel files 'not supported'. Freezes on blocksize 16384 and 13456. 192kHz is played back very slow. Skips all multichannel, files with cover image, extreme metadata. Reboot loop on extreme large VORBISCOMMENT |
|- | |- | ||
! Kenwood KMM-BT304 | ! Kenwood KMM-BT304 | ||
Line 127: | Line 189: | ||
| style="background: red;" | Reboots | | style="background: red;" | Reboots | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | - |
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | File 03 plays extremely noisily, barely recognizable. File 51 produces a "NO DEVICE" error and a reboot. File 54 produces a reboot with no message. These files produce a "NA FILE" error and the player skips to the next: 19 21 24 25 26 27 29 30 31 34 35 36 38 39 40 41 42 43 44 45 46 48 55. (firmware: te1706k.krm from 2020-03-05) | ||
+ | |- | ||
+ | ! Lenco Xemio-240 | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Freezes|Freezes on non-standard sample rates (34567Hz and 39kHz)}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" colspan="8" | {{tooltip|Rejects|Returns message 'File format not supported!'}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|Player is unresponsive during loading, which takes a while}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|20 bit and 24 bit files are played back with shorts bursts of loud static}} | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version V5.15, dated 2020-04-24 | ||
|- | |- | ||
! Onkyo TX-NR686 | ! Onkyo TX-NR686 | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Heavy stutter with blocksize 16}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Non-standard sample rates (34567Hz and 39kHz) are skipped}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Does not play current format variable blocksize files but does play 'pre-2007 format' variable blocksize files}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Non-standard sample rates (134560Hz and 384kHz) are skipped}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" colspan="2" | Rejects | + | | style="background: yellow;" colspan="2" | {{tooltip|Rejects|Does not play 4.0, 5.1 and 7.1 files but does play 5.0 and 6.1 as stereo and 3.0 as 3.1}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Reboots | + | | style="background: red;" | {{tooltip|Reboots|Crashes on file with 1000x repeating VORBISCOMMENT}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | style="background: lime;" | Plays |
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Tested with revision 6, firmware version 1071-2000-1070-0011. | ||
|- | |- | ||
! Panasonic TX-60CX750E | ! Panasonic TX-60CX750E | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Non-standard sample rates (34567Hz and 39kHz) are stretched i.e. played at wrong speed}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
Line 155: | Line 237: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Non-standard sample rates (134560Hz and 384kHz) are stretched i.e. played at wrong speed}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|Multichannel condensed into 2 channels}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Does not start playing}} | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Does not start playing on extremely large vorbiscomment}} | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | |||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | Based on libFLAC 1.2.1. | + | | - |
+ | | class="mw-collapsible mw-collapsed" | Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6 | ||
|- | |- | ||
! Pioneer BDP-150 | ! Pioneer BDP-150 | ||
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on non-standard blocksizes (16, 254, 725, 1000 and 1937)}} |
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Garbled audio when playing file with LPC with qlp precision of 2}} |
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on variable blocksize files with non-standard blocksizes, stutters on variable blocksize files with standard blocksizes}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on non-standard blocksize (13456)}} |
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Incorrect decoding (clicks) of RICE2 partitions with escape codes}} |
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz. Stutters on 192kHz with 32th order predictors}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" colspan="2" | Freezes | + | | style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on files with more than 6 channels}} |
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on files with an unknown number of total samples}} |
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on files with 1000x repeated vorbiscomments, rejects files with too many seekpoints}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | style="background: lime;" | Plays |
+ | | style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}} | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Firmware v1.08, testbench revision 6 | ||
+ | |- | ||
+ | ! Pioneer DEH-1900UB | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips non-standard blocksizes (16, 254, 725, 1000 and 1937)}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips non-standard samplerates}} | ||
+ | | style="background: yellow;" | Skips | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips file 24 and 25}} | ||
+ | | style="background: yellow;" colspan="7" | Skips | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Other|Plays, but takes about a minute time to start playing. During this wait, track can be skipped, unit does not become unresponsive}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Testbench revision 5 | ||
|- | |- | ||
! Rockbox | ! Rockbox | ||
Line 188: | Line 291: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;"| | + | | style="background: yellow;"| {{tooltip|Skips|Skips blocksizes 16384 and 13456}} |
− | | style="background: yellow;"| | + | | style="background: yellow;"| {{tooltip|Skips|Skips file with only 32nd order predictors}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" colspan="2" | Freezes | + | | style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on files with more than 6 channels}} |
+ | | style="background: red;" | {{tooltip|Freezes|Crashes on filewith no total number of samples set}} | ||
+ | | style="background: orange;"| {{tooltip|Fails|Plays extremely slowly on file with APPLICATION metadata block}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Plays 20-bit and 24-bit file but with loud bursts of static}} | ||
| - | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 6 | ||
+ | |- | ||
+ | ! Sony BDP-1700 | ||
+ | | style="background: red;" | {{tooltip|Freezes|Freezes on non-standard blocksizes (254, 725, 1000 and 1937)}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Garbled audio when playing file with LPC with qlp precision of 2}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Freezes|Freezes on variable blocksize files with non-standard blocksizes, stutters on variable blocksize files with standard blocksizes}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Freezes|Freezes on non-standard blocksize (13456)}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Incorrect decoding (clicks) of RICE2 partitions with escape codes}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Stretches non-standard samplerates to 44.1kHz. Stutters on 192kHz with 32th order predictors}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on files with more than 6 channels}} | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips file with an unknown number of total samples}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Plays but skips parts of 24-bit file}} | ||
| - | | - | ||
− | + | | class="mw-collapsible mw-collapsed" | Firmware m30.R.0527, testbench revision 6 | |
− | | class="mw-collapsible mw-collapsed" | | + | |
|- | |- | ||
! colspan="16" | Software players | ! colspan="16" | Software players | ||
Line 214: | Line 340: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|version 1.6.8 plays. 1.6.7: Error message: Unable to open item for playback (bad allocation)}} | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | | + | | style="background: lime;" | Plays |
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Foobar2000 version 1.6.8 with testbench revision 5, version 1.6.11 with revision 6 <i>updates</i> only. | ||
|- | |- | ||
! VLC | ! VLC | ||
Line 223: | Line 352: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: orange;" | Fails | + | | style="background: orange;" | {{tooltip|Fails|Unable to play old-style variable blocksize}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
Line 232: | Line 361: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Crashes | + | | style="background: red;" | {{tooltip|Crashes|Crashes occasionally on files with extremely large VORBISCOMMENT}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | style="background: lime;" | Plays |
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | VLC 3.0.16 on testbench revision 5 <br>VLC 3.0.17.4 on files 60 to 63. | ||
|- | |- | ||
! Winamp 5.8 | ! Winamp 5.8 | ||
Line 240: | Line 372: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on 12 bit file}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" | Freezes | + | | style="background: red;" | {{tooltip|Freezes|Freezes on 384kHz}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: red;" colspan="2" | Freezes | + | | style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on 3.0, 5.0, 6.1 and 7.1 files}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | - |
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Winamp 5.8 build 3660, testbench revision 5 | ||
|- | |- | ||
! Windows Media Player | ! Windows Media Player | ||
Line 257: | Line 392: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
Line 263: | Line 398: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | style="background: yellow;" | Rejects | + | | style="background: yellow;" | {{tooltip|Rejects|Rejects all}} |
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | - |
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Tested version 12.0.19041.1288 on testbench revision 5 | ||
|- | |- | ||
! mpv | ! mpv | ||
Line 285: | Line 423: | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Hangs|Hangs on files with 1000x repeating vorbiscomments}} | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
| style="background: lime;" | Plays | | style="background: lime;" | Plays | ||
− | | class="mw-collapsible mw-collapsed" | | + | | style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}} |
− | |} | + | | - |
+ | | class="mw-collapsible mw-collapsed" | mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63 | ||
+ | |- | ||
+ | ! Mediamonkey 5 | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Crashes|Crashes on 12-bit file}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Silence|Plays silence on 20-bit file.}} | ||
+ | | style="background: orange;" | {{tooltip|Breaks|Only plays first 2 seconds of all spoken multichannel files}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Unresp.|GUI becomes unresponsive on (and after) playing files with 1000x repeating vorbiscomments}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Version 5.0.1.2433 with testbench revision 5 | ||
+ | |- | ||
+ | ! Mplayer (Windows) | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Stuck at beginning of 384 kHz file, but one can skip with arrow button to play last part}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}} | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63 | ||
+ | |- | ||
+ | ! ffplay (Windows) | ||
+ | | style="background: orange;" | {{tooltip|Fails|Wrong speed on blocksize 16}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5 | ||
+ | |- | ||
+ | ! Spotify (Windows) | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 12 bits per sample}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 384 kHz}} | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 20 bits}} | ||
+ | | style="background: yellow;" | {{tooltip|Skips (?)|Skips all multi-channel}} | ||
+ | | style="background: yellow;" | {{tooltip|Skips (?)|Skips all multi-channel}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Rejects|Does not index any of the 'extremely large' 48-52 & 55}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel). | ||
+ | |- | ||
+ | ! JRiver Media Center | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|lowers volume on 12 bit and 8 bit}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Rejects|rejects (with error message) extremely large VORBISCOMMENT. Still plays the all-combined 55.}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | version 28.0.88 64-bit with testbench revision 5 | ||
+ | |- | ||
+ | ! Amarok (Windows) | ||
+ | | style="background: orange;" | {{tooltip|Fails|Plays silence on blocksizes 16, 254, 725, 1000, 1937, 2304. (Could be provoked to play a split second of one.)}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Crashes|Crashes on 8 bits. And plays silence on 12 bits}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Silence on blocksize 13456}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 384 kHz}} | ||
+ | | style="background: orange;" | {{tooltip|Fails|Silence on 20 bits}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Silence on 20 bits, like on number 37}} | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | Amarok version 2.8.0 with testbench revision 5 and 60-63 | ||
+ | |- | ||
+ | ! Exaile (Windows) | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Version 4.1.2 beta1: File 25 Flake smaller blocksize is played back noisy. File 27 old format mutes after a split second. Version 4.1.1: Skips all variable blocksize files, except: stops upon the old format flake 0.11 (but can resume playback on different file)}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | First tested version 4.1.1 (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63 | ||
+ | |- | ||
+ | ! Quod Libet (Windows) | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: orange;" | {{tooltip|Fails|Chirp sounds on old-format 0.11. Other variable blocksize files makes player skip subsequent file(s) in the playlist.}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: yellow;" | {{tooltip|Skips|Skips 384 kHz}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6. | ||
+ | |- | ||
+ | ! Cog | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|Versions before 1630 will reject the 12 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | {{tooltip|Plays|Versions before 1630 will reject this 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}} | ||
+ | | style="background: lime;" | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as test 43 incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}} | ||
+ | | style="background: lime;" | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as this test incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" |{{tooltip|Plays|Versions before 1630 will reject the 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}} | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | version 2169 (2169-gbf54c452) with testbench revision 6 | ||
+ | |- | ||
+ | ! GoneMAD (Android) | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | Crashes | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: red;" | {{tooltip|Hangs|Hangs on 55. Also unresponsible UI on 51, but plays.}} | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | - | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | testbench revision 5 | ||
+ | |- | ||
+ | ! VUPlayer | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | style="background: lime;" | Plays | ||
+ | | - | ||
+ | | class="mw-collapsible mw-collapsed" | VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6. | ||
+ | |-} | ||
{| class="wikitable" cellspacing="2" | {| class="wikitable" cellspacing="2" |
Revision as of 12:12, 30 July 2022
To further the use and development of FLAC, a testbench containing files with different parameters was constructed. The testbench consists of 63 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users.
The testbench can be downloaded here (revision 7) and is maintained here. It is licensed under CC0 1.0.
Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the readme.txt file. Revision 7 replaces file 63 (which was faulty in revision 6) and adds file 64.
CDDA (44.1kHz/16-bit and less) | High-res (96kHz/24-bit and more) | Multichannel | Metadata | Various | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Decoder | Blocksizes | Features | Samplerates | Bitdepths | Var. bl.size | General | Blocksize | Features | Samplerates | Bitdepths | General | Features | Missing | Extreme | MIME | Mono | Overfl. | Zero esc. | Remarks |
Files in test set | 1-10 | 11-18 | 19-21 | 22-23 | 24-27 | 28 | 29-30 | 31-32, 34 | 33-36 | 37 | 38-43 | 44 | 45-47 | 48-55 | 56-59 | 60 | 61-63 | 64 | |
Android | Fails | Plays | Plays | Plays | Skips | Plays | Plays | Plays | Plays | Fails | Fails | Skips | Plays | Plays | Plays | - | - | - | Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5 |
Citroën DS5 | Plays | Plays | Skips | Fails | Plays | Skips | Plays | Hangs | Plays | - | - | - | |||||||
Chromecast | Fails | Plays | Fails | Plays | Fails | Plays | Plays | Plays | Fails | Plays | Plays | Plays | Plays | Plays | Skips | Plays | Skips | Plays | Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7 |
Cowon iAudio 7 | Fails | Plays | Fails | Rejects | Rejects | Rejects | Rejects | Rejects | Rejects | Rejects | Freezes | - | - | - | - | - | - | Freezes on blocksizes 254, 725; skips file with blocksize 1937. 38457Hz and 41kHz are speeded up; 22050 Plays. All files with bitdepth other than 16 are skipped. Files with variable block size are skipped. 3.0 plays as silence, others 16/44 MCH files make freeze. | |
Ford SYNC | Plays | Plays | Plays | Skips | Plays | Plays | Plays | Plays | Plays | Skips | Plays | Plays | Plays | Skips | Plays | - | - | - | Tested with revision 5, SYNC version 3.3, build 18201_PRODUCT |
JVC KD-R871BT | Fails | Plays | Fails | Plays | Rejects | Plays | Freezes | Reboots | Fails | Rejects | Rejects | Rejects | Reboots | Rejects | - | - | - | Heavy stutter with blocksize 16. Stretches non-standard samplerates. Samplerates above 96kHz, variable blocksize files and multichannel files 'not supported'. Freezes on blocksize 16384 and 13456. 192kHz is played back very slow. Skips all multichannel, files with cover image, extreme metadata. Reboot loop on extreme large VORBISCOMMENT | |
Kenwood KMM-BT304 | Fails | Plays | Rejects | Plays | Rejects | Plays | Rejects | Rejects | Rejects | Plays | Rejects | Rejects | Plays | Reboots | Plays | - | - | - | File 03 plays extremely noisily, barely recognizable. File 51 produces a "NO DEVICE" error and a reboot. File 54 produces a reboot with no message. These files produce a "NA FILE" error and the player skips to the next: 19 21 24 25 26 27 29 30 31 34 35 36 38 39 40 41 42 43 44 45 46 48 55. (firmware: te1706k.krm from 2020-03-05) |
Lenco Xemio-240 | Plays | Plays | Freezes | Plays | Rejects | Plays | Plays | Plays | Plays | Fails | - | Tested with revision 6, firmware version V5.15, dated 2020-04-24 | |||||||
Onkyo TX-NR686 | Fails | Plays | Rejects | Plays | Rejects | Plays | Plays | Plays | Rejects | Plays | Rejects | Plays | Reboots | Plays | Plays | Plays | - | Tested with revision 6, firmware version 1071-2000-1070-0011. | |
Panasonic TX-60CX750E | Plays | Plays | Fails | Plays | Plays | Plays | Plays | Plays | Fails | Plays | Plays | Fails | Plays | Fails | Plays | Plays | Plays | - | Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6 |
Pioneer BDP-150 | Freezes | Fails | Fails | Plays | Freezes | Plays | Freezes | Fails | Fails | Plays | Freezes | Freezes | Freezes | Plays | Plays | Fails | - | Firmware v1.08, testbench revision 6 | |
Pioneer DEH-1900UB | Skips | Plays | Skips | Skips | Skips | Skips | Plays | Other | Plays | - | - | - | Testbench revision 5 | ||||||
Rockbox | Plays | Plays | Plays | Plays | Plays | Plays | Skips | Skips | Plays | Plays | Freezes | Freezes | Fails | Plays | Plays | Fails | - | Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 6 | |
Sony BDP-1700 | Freezes | Fails | Fails | Plays | Freezes | Plays | Freezes | Fails | Fails | Plays | Freezes | Skips | Plays | Plays | Plays | Fails | - | Firmware m30.R.0527, testbench revision 6 | |
Software players | |||||||||||||||||||
Foobar 2000 | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | - | Foobar2000 version 1.6.8 with testbench revision 5, version 1.6.11 with revision 6 updates only. |
VLC | Plays | Plays | Plays | Plays | Fails | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Crashes | Plays | Plays | Plays | - | VLC 3.0.16 on testbench revision 5 VLC 3.0.17.4 on files 60 to 63. |
Winamp 5.8 | Plays | Plays | Plays | Freezes | Plays | Plays | Plays | Plays | Freezes | Plays | Freezes | Plays | Plays | Plays | - | - | - | Winamp 5.8 build 3660, testbench revision 5 | |
Windows Media Player | Plays | Plays | Plays | Rejects | Plays | Plays | Plays | Plays | Plays | Rejects | Plays | Plays | Plays | Rejects | Plays | - | - | - | Tested version 12.0.19041.1288 on testbench revision 5 |
mpv | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Hangs | Plays | Plays | Fails | - | mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63 |
Mediamonkey 5 | Plays | Plays | Plays | Crashes | Plays | Plays | Plays | Plays | Plays | Silence | Breaks | Plays | Plays | Unresp. | Plays | - | - | - | Version 5.0.1.2433 with testbench revision 5 |
Mplayer (Windows) | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Fails | Plays | Plays | Plays | Unresp. | Plays | Plays | Fails | - | Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63 |
ffplay (Windows) | Fails | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Unresp. | Plays | - | - | - | version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5 |
Spotify (Windows) | Plays | Plays | Plays | Skips | Plays | Plays | Plays | Plays | Skips | Skips | Skips (?) | Skips (?) | Plays | Rejects | Plays | Plays | Plays | - | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel). |
JRiver Media Center | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Rejects | Plays | - | - | - | version 28.0.88 64-bit with testbench revision 5 |
Amarok (Windows) | Fails | Plays | Plays | Crashes | Plays | Plays | Fails | Plays | Skips | Fails | Plays | Plays | Plays | Plays | Plays | Plays | Fails | - | Amarok version 2.8.0 with testbench revision 5 and 60-63 |
Exaile (Windows) | Plays | Plays | Plays | Plays | Fails | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | - | First tested version 4.1.1 (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63 |
Quod Libet (Windows) | Plays | Plays | Plays | Plays | Fails | Plays | Plays | Plays | Skips | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | - | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6. |
Cog | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | - | version 2169 (2169-gbf54c452) with testbench revision 6 |
GoneMAD (Android) | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Crashes | Plays | Hangs | Plays | - | - | - | testbench revision 5 |
VUPlayer | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | Plays | - | VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6. |
Table legend | |
---|---|
Plays | all files in this category are played as intended, without glitches, changes etc. |
Rejects | One or more files are rejected by the player, either by skipping the file or mentioning a message like: "file not supported" |
Fails | One or more files are not played back as intended, for example by stuttering, garbling or playing at incorrect speed, or by never starting playing (though not skipping, freezing or rebooting) |
Freezes | On one or more files, the player crashes on decoding, leaving the unit inoperable until reboot, or the unit reboots by itself |
The order of precedence is from bottom to top, so if one file freezes the player, one file is rejected and the other play fine, the table reads 'Freezes' for that category. | |
For the metadata tests, the (absence of) rendering of the metadata is not a criterium, simply whether its presence is an obstacle to playing |