Difference between revisions of "FLAC decoder testbench"

From Hydrogenaudio Knowledgebase
Jump to: navigation, search
(Alphabetically sorted)
Line 75: Line 75:
 
| -
 
| -
 
| class="mw-collapsible mw-collapsed" | Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5
 
| class="mw-collapsible mw-collapsed" | Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5
−
|-
 
−
! Citroën DS5
 
−
| style="background: lime;"  | Plays
 
−
| style="background: lime;"  | Plays
 
−
| style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate, plays 22050Hz}}
 
−
| style="background: orange;" | {{tooltip|Fails|Extreme distortion on playback}}
 
−
| style="background: lime;"  | Plays
 
−
| style="background: yellow;" colspan="7" | {{tooltip|Skips|Skips all high-res and multichannel files}}
 
−
| style="background: lime;"  | Plays
 
−
| style="background: red;"    | {{tooltip|Hangs|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}}
 
−
| style="background: lime;"  | Plays
 
−
| -
 
−
| -
 
−
| -
 
−
|
 
 
|-
 
|-
 
! Chromecast
 
! Chromecast
Line 111: Line 96:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| class="mw-collapsible mw-collapsed" | Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7
 
| class="mw-collapsible mw-collapsed" | Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7
 +
|-
 +
! Citroën DS5
 +
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Skips|Skips files with a non-standard samplerate, plays 22050Hz}}
 +
| style="background: orange;" | {{tooltip|Fails|Extreme distortion on playback}}
 +
| style="background: lime;"  | Plays
 +
| style="background: yellow;" colspan="7" | {{tooltip|Skips|Skips all high-res and multichannel files}}
 +
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Hangs|Files with large seektable are skipped (after long delay) and file with combined extreme metadata causes player to hang, requiring removal of USB stick}}
 +
| style="background: lime;"  | Plays
 +
| -
 +
| -
 +
| -
 +
|
 
|-
 
|-
 
! Cowon iAudio 7
 
! Cowon iAudio 7
Line 327: Line 327:
 
! colspan="16" | Software players
 
! colspan="16" | Software players
 
|-
 
|-
−
! foobar2000 2.0 beta 7 [x86]
+
! AIMP 5.03 build 2398 (Windows)
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 341: Line 341:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;" | {{tooltip|Plays|Since version 1.6.8}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;" | Plays
+
| style="background: lime;"   | Plays
−
| class="mw-collapsible mw-collapsed" | Testbench revision 7
+
| style="background: orange;" | {{tooltip|Fails|Stuttering playback}}
 +
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
 
|-
 
|-
−
! VLC
+
! Album Player 2.114 (Windows)
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Fails|Gives out error on 12 bit. Only noise on 8 bit.}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Unable to play old-style variable blocksize}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
 +
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 6.1 and 7.1}}
 +
| style="background: yellow;" | {{tooltip|Rejects|Gives out error}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"   | {{tooltip|Crashes|Crashes occasionally on files with extremely large VORBISCOMMENT}}
+
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | Plays
+
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
−
| style="background: lime;"  | Plays
+
−
| style="background: lime;"  | Plays
+
−
| class="mw-collapsible mw-collapsed" | VLC 3.0.16 on testbench revision 5 <br>VLC 3.0.17.4 on files 60 to 63.<br>VLC 3.0.16 on file 64
+
 
|-
 
|-
−
! Winamp 5.8
+
! Amarok (Windows)
 +
| style="background: orange;"  | {{tooltip|Fails|Plays silence on blocksizes 16, 254, 725, 1000, 1937, 2304. (Could be provoked to play a split second of one.)}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;"  | {{tooltip|Crashes|Crashes on 8 bits. And plays silence on 12 bits}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Freezes|Freezes on 12 bit file}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;"  | {{tooltip|Fails|Silence on blocksize 13456}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
 +
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Freezes|Freezes on 384kHz}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on 3.0, 5.0, 6.1 and 7.1 files}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits, like on number 37}}
 
| -
 
| -
−
| -
+
| class="mw-collapsible mw-collapsed" | Amarok version 2.8.0 with testbench revision 5 and 60-63
−
| -
+
−
| class="mw-collapsible mw-collapsed" | Winamp 5.8 build 3660, testbench revision 5
+
 
|-
 
|-
−
! Windows Media Player
+
! Cog
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}}
+
| style="background: lime;"   | {{tooltip|Plays|Versions before 1630 will reject the 12 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 399: Line 400:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
+
| style="background: lime;"   | {{tooltip|Plays|Versions before 1630 will reject this 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
 +
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as test 43 incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
 +
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as this test incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Rejects|Rejects all}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: lime;"  |{{tooltip|Plays|Versions before 1630 will reject the 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
 
| -
 
| -
−
| -
+
| class="mw-collapsible mw-collapsed" | version 2169 (2169-gbf54c452) with testbench revision 6
−
| -
+
−
| class="mw-collapsible mw-collapsed" | Tested version 12.0.19041.1288 on testbench revision 5
+
 
|-
 
|-
−
! mpv
+
! Exaile (Windows)
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: orange;"    | {{tooltip|Fails|Version 4.1.2 beta1: File 25 Flake smaller blocksize is played back noisy. File 27 old format mutes after a split second. Version 4.1.1: Skips all variable blocksize files, except: stops upon the old format flake 0.11 (but can resume playback on different file)}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 424: Line 427:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Hangs|Hangs on files with 1000x repeating vorbiscomments}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
 
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63
+
| class="mw-collapsible mw-collapsed" | First tested version 4.1.1  (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
 
|-
 
|-
−
! Mediamonkey 5
+
! ffplay (Windows)
 +
| style="background: orange;"  | {{tooltip|Fails|Wrong speed on blocksize 16}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Crashes|Crashes on 12-bit file}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 441: Line 442:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Silence|Plays silence on 20-bit file.}}
 
−
| style="background: orange;" | {{tooltip|Breaks|Only plays first 2 seconds of all spoken multichannel files}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Unresp.|GUI becomes unresponsive on (and after) playing files with 1000x repeating vorbiscomments}}
+
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| -
 
| -
 
| -
 
| -
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | Version 5.0.1.2433 with testbench revision 5
+
| class="mw-collapsible mw-collapsed" | version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5
 
|-
 
|-
−
! Mplayer (Windows)
+
! foobar2000 2.0 beta 7 [x86]
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 462: Line 463:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Stuck at beginning of 384 kHz file, but one can skip with arrow button to play last part}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: lime;" | {{tooltip|Plays|Since version 1.6.8}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
+
| style="background: lime;"   | Plays
−
| -
+
| style="background: lime;"  | Plays
−
| class="mw-collapsible mw-collapsed" | Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63
+
| style="background: lime;" | Plays
 +
| class="mw-collapsible mw-collapsed" | Testbench revision 7
 
|-
 
|-
−
! ffplay (Windows)
+
! GoneMAD (Android)
−
| style="background: orange;"  | {{tooltip|Fails|Wrong speed on blocksize 16}}
+
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 486: Line 486:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;"    | Crashes
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}}
+
| style="background: red;"    | {{tooltip|Hangs|Hangs on 55. Also unresponsible UI on 51, but plays.}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| -
 
| -
 
| -
 
| -
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5
+
| class="mw-collapsible mw-collapsed" | testbench revision 5
 
|-
 
|-
−
! Spotify (Windows)
+
! JRiver Media Center
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Skips|Skips 12 bits per sample}}
+
| style="background: lime;"   | {{tooltip|Plays|lowers volume on 12 bit and 8 bit}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
 
−
| style="background: yellow;"  | {{tooltip|Skips|Skips 20 bits}}
 
−
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
 
−
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;"    | {{tooltip|Rejects|Does not index any of the 'extremely large' 48-52 & 55}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Rejects|rejects (with error message) extremely large VORBISCOMMENT. Still plays the all-combined 55.}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
+
| -
 +
| -
 +
| class="mw-collapsible mw-collapsed" | version 28.0.88 64-bit with testbench revision 5
 
|-
 
|-
−
! JRiver Media Center
+
! Mediamonkey 5
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"   | {{tooltip|Plays|lowers volume on 12 bit and 8 bit}}
+
| style="background: red;"   | {{tooltip|Crashes|Crashes on 12-bit file}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 525: Line 526:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Silence|Plays silence on 20-bit file.}}
 +
| style="background: orange;" | {{tooltip|Breaks|Only plays first 2 seconds of all spoken multichannel files}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | Plays
+
| style="background: red;"   | {{tooltip|Unresp.|GUI becomes unresponsive on (and after) playing files with 1000x repeating vorbiscomments}}
−
| style="background: lime;"  | Plays
+
−
| style="background: yellow;" | {{tooltip|Rejects|rejects (with error message) extremely large VORBISCOMMENT. Still plays the all-combined 55.}}
+
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| -
 
| -
 
| -
 
| -
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | version 28.0.88 64-bit with testbench revision 5
+
| class="mw-collapsible mw-collapsed" | Version 5.0.1.2433 with testbench revision 5
 
|-
 
|-
−
! Amarok (Windows)
+
! Mplayer (Windows)
−
| style="background: orange;"  | {{tooltip|Fails|Plays silence on blocksizes 16, 254, 725, 1000, 1937, 2304. (Could be provoked to play a split second of one.)}}
+
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"  | {{tooltip|Crashes|Crashes on 8 bits. And plays silence on 12 bits}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;"  | {{tooltip|Fails|Silence on blocksize 13456}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
 
−
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Fails|Stuck at beginning of 384 kHz file, but one can skip with arrow button to play last part}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;"  | {{tooltip|Fails|Silence on 20 bits, like on number 37}}
+
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Unresp.|Took over a minute before starting to playing the '55 - file 48-53 combined.flac'}}
 +
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | Amarok version 2.8.0 with testbench revision 5 and 60-63
+
| class="mw-collapsible mw-collapsed" | Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63
 
|-
 
|-
−
! Exaile (Windows)
+
! mpv
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | Plays
 
−
| style="background: orange;"    | {{tooltip|Fails|Version 4.1.2 beta1: File 25 Flake smaller blocksize is played back noisy. File 27 old format mutes after a split second. Version 4.1.1: Skips all variable blocksize files, except: stops upon the old format flake 0.11 (but can resume playback on different file)}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 573: Line 572:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Hangs|Hangs on files with 1000x repeating vorbiscomments}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Fails|Stutters on 24-bit predictor overflow check}}
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | First tested version 4.1.1  (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
+
| class="mw-collapsible mw-collapsed" | mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63
 
|-
 
|-
 
! Quod Libet (Windows)
 
! Quod Libet (Windows)
Line 599: Line 600:
 
| class="mw-collapsible mw-collapsed" | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
 
| class="mw-collapsible mw-collapsed" | version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
 
|-
 
|-
−
! Cog
+
! Spotify (Windows)
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"   | {{tooltip|Plays|Versions before 1630 will reject the 12 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
+
| style="background: yellow;" | {{tooltip|Skips|Skips 12 bits per sample}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;"  | {{tooltip|Skips|Skips 384 kHz}}
 +
| style="background: yellow;"  | {{tooltip|Skips|Skips 20 bits}}
 +
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
 +
| style="background: yellow;"  | {{tooltip|Skips (?)|Skips all multi-channel}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"   | {{tooltip|Plays|Versions before 1630 will reject this 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
+
| style="background: yellow;"   | {{tooltip|Rejects|Does not index any of the 'extremely large' 48-52 & 55}}
−
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as test 43 incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
+
−
| style="background: lime;"  | {{tooltip|Plays|Versions before 1647 will downmix 8 channel files such as this test incorrectly, but they will decode properly, and play back properly if the sound output device supports 8 channels directly.}}
+
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | Plays
 
−
| style="background: lime;"  |{{tooltip|Plays|Versions before 1630 will reject the 20 bit file, because they did not properly handle files with bit depths that aren't a multiple of 8.}}
 
 
| -
 
| -
−
| class="mw-collapsible mw-collapsed" | version 2169 (2169-gbf54c452) with testbench revision 6
+
| class="mw-collapsible mw-collapsed" | Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
 
|-
 
|-
−
! GoneMAD (Android)
+
! VLC
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: orange;" | {{tooltip|Fails|Unable to play old-style variable blocksize}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 632: Line 634:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | Crashes
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: red;"    | {{tooltip|Hangs|Hangs on 55. Also unresponsible UI on 51, but plays.}}
+
| style="background: red;"    | {{tooltip|Crashes|Crashes occasionally on files with extremely large VORBISCOMMENT}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| -
+
| style="background: lime;"  | Plays
−
| -
+
| style="background: lime;"  | Plays
−
| -
+
| style="background: lime;"  | Plays
−
| class="mw-collapsible mw-collapsed" | testbench revision 5
+
| class="mw-collapsible mw-collapsed" | VLC 3.0.16 on testbench revision 5 <br>VLC 3.0.17.4 on files 60 to 63.<br>VLC 3.0.16 on file 64
 
|-
 
|-
 
! VUPlayer
 
! VUPlayer
Line 662: Line 663:
 
| class="mw-collapsible mw-collapsed" | VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6.
 
| class="mw-collapsible mw-collapsed" | VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6.
 
|-
 
|-
−
! XMPlay
+
! Winamp 5.8
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Freezes|Freezes on 12 bit file}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;"    | {{tooltip|Freezes|Freezes on 384kHz}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: red;" colspan="2" | {{tooltip|Freezes|Freezes on 3.0, 5.0, 6.1 and 7.1 files}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | {{tooltip|Plays|But output channel layout for 6.1 is incorrect: FL,FR,FC,LFE,BL,BR,BC instead of FL,FR,FC,LFE,BC,SL,SR}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: lime;"  | Plays
+
| -
−
| style="background: lime;"  | Plays
+
| -
−
| style="background: lime;"  | Plays
+
| -
−
| style="background: lime;"  | Plays
+
| class="mw-collapsible mw-collapsed" | Winamp 5.8 build 3660, testbench revision 5
−
| style="background: lime;"  | Plays
+
−
| style="background: lime;"  | Plays
+
−
| class="mw-collapsible mw-collapsed" | XMPlay 3.8.5 with FLAC decoder revision 12 tested with testbench revision 7.
+
 
|-
 
|-
−
! AIMP 5.03 build 2398 (Windows)
+
! Windows Media Player
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Rejects|Rejects 12 bit file}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 692: Line 693:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Rejects|Rejects 20 bit file}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: yellow;" | {{tooltip|Rejects|Rejects all}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| -
 +
| -
 +
| -
 +
| class="mw-collapsible mw-collapsed" | Tested version 12.0.19041.1288 on testbench revision 5
 +
|-
 +
! XMPlay
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
Line 701: Line 710:
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Stuttering playback}}
 
−
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
 
−
|-
 
−
! Album Player 2.114 (Windows)
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: orange;" | {{tooltip|Fails|Gives out error on 12 bit. Only noise on 8 bit.}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 +
| style="background: lime;"  | {{tooltip|Plays|But output channel layout for 6.1 is incorrect: FL,FR,FC,LFE,BL,BR,BC instead of FL,FR,FC,LFE,BC,SL,SR}}
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
 
−
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 6.1 and 7.1}}
 
−
| style="background: yellow;" | {{tooltip|Rejects|Gives out error}}
 
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
 
| style="background: lime;"  | Plays
−
| style="background: yellow;" | {{tooltip|Rejects|Gives out error on 20 bit}}
+
| class="mw-collapsible mw-collapsed" | XMPlay 3.8.5 with FLAC decoder revision 12 tested with testbench revision 7.
−
| style="background: lime;"  | Plays
+
−
| class="mw-collapsible mw-collapsed" | Testbench revision 7.
+
 
|-}
 
|-}
 
|-}
 
|-}

Revision as of 16:04, 17 September 2022

To further the use and development of FLAC, a testbench containing files with different parameters was constructed. The testbench consists of 64 FLAC files, each one having a different combination of characteristics (like samplerate, bitdepth and number of channels) and FLAC features (like blocksize, maximum partition order, maximum predictor order, maximum predictor precision etc.) However, all combinations fall within the so called subset: a limited set of FLAC parameters that fit in the frame header and are supposed to be 'streamable'. Please be aware that certain tested features (such as blocksize 16 or a samplerate of 38457Hz) are pretty much useless in day-to-day usage, and that failure to properly decode such a file is mostly of interest to developers than to users.

The testbench can be downloaded here (revision 7) and is maintained here. It is licensed under CC0 1.0.

Revision 6 adds four new files (60 to 63); files 1 through 59 are the same as in revision 5. For more information on which file tests what characteristics and features, please refer to the readme.txt file. Revision 7 replaces file 63 (which was faulty in revision 6) and adds file 64.

CDDA (44.1kHz/16-bit and less) High-res (96kHz/24-bit and more) Multichannel Metadata Various
Decoder Block­sizes Features Sample­rates Bit­depths Var. bl.size General Block­size Features Sample­rates Bit­depths General Features Missing Extreme MIME Mono Overfl. Zero esc. Remarks
Files in test set 1-10 11-18 19-21 22-23 24-27 28 29-30 31-32, 34 33-36 37 38-43 44 45-47 48-55 56-59 60 61-63 64
Android Fails Plays Plays Plays Skips Plays Plays Plays Plays Fails Fails Skips Plays Plays Plays - - - Android 11 with Google Play updates of 1st of August 2021 on Samsung XCover 5
Chromecast Fails Plays Fails Plays Fails Plays Plays Plays Fails Plays Plays Plays Plays Plays Skips Plays Skips Plays Tested with system firmware 275994 and cast firmware 1.56.275994, testbench revision 7
Citroën DS5 Plays Plays Skips Fails Plays Skips Plays Hangs Plays - - -
Cowon iAudio 7 Freezes Plays Fails Rejects Rejects Rejects Rejects Rejects Rejects Rejects Freezes Rejects - - Plays Plays Rejects Plays Device doesn't support FLAC with bitdepth other than 16 and samplerate higher than 44.1 kHz. So actual features of files 45-54 and 62-63 cannot be tested. File 55 plays, but takes long time to start.
Ford SYNC Plays Plays Plays Skips Plays Plays Plays Plays Plays Skips Plays Plays Plays Skips Plays - - - Tested with revision 5, SYNC version 3.3, build 18201_PRODUCT
JVC KD-R871BT Fails Plays Fails Plays Rejects Plays Freezes Reboots Fails Rejects Rejects Rejects Reboots Rejects - - - Heavy stutter with blocksize 16. Stretches non-standard samplerates. Samplerates above 96kHz, variable blocksize files and multichannel files 'not supported'. Freezes on blocksize 16384 and 13456. 192kHz is played back very slow. Skips all multichannel, files with cover image, extreme metadata. Reboot loop on extreme large VORBISCOMMENT
Kenwood KMM-BT304 Fails Plays Rejects Plays Rejects Plays Rejects Rejects Rejects Plays Rejects Rejects Plays Reboots Plays - - - File 03 plays extremely noisily, barely recognizable. File 51 produces a "NO DEVICE" error and a reboot. File 54 produces a reboot with no message. These files produce a "NA FILE" error and the player skips to the next: 19 21 24 25 26 27 29 30 31 34 35 36 38 39 40 41 42 43 44 45 46 48 55. (firmware: te1706k.krm from 2020-03-05)
Lenco Xemio-240 Plays Plays Freezes Plays Rejects Plays Plays Plays Plays Fails - Tested with revision 6, firmware version V5.15, dated 2020-04-24
Onkyo TX-NR686 Fails Plays Rejects Plays Rejects Plays Plays Plays Rejects Plays Rejects Plays Reboots Plays Plays Plays - Tested with revision 6, firmware version 1071-2000-1070-0011.
Panasonic TX-60CX750E Plays Plays Fails Plays Plays Plays Plays Plays Fails Plays Plays Fails Plays Fails Plays Plays Plays - Based on libFLAC 1.2.1, according to copyright notice. Firmware version 3.228, testbench revision 6
Pioneer BDP-150 Freezes Fails Fails Plays Freezes Plays Freezes Fails Fails Plays Freezes Freezes Freezes Plays Plays Fails - Firmware v1.08, testbench revision 6
Pioneer DEH-1900UB Skips Plays Skips Skips Skips Skips Plays Other Plays - - - Testbench revision 5
Rockbox Plays Plays Plays Plays Plays Plays Skips Skips Plays Plays Freezes Freezes Fails Plays Plays Fails - Tested with Rockbox 3.15 (latest stable) on Sansa Fuze with testbench revision 6
Sony BDP-1700 Freezes Fails Fails Plays Freezes Plays Freezes Fails Fails Plays Freezes Skips Plays Plays Plays Fails - Firmware m30.R.0527, testbench revision 6
Software players
AIMP 5.03 build 2398 (Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails Testbench revision 7.
Album Player 2.114 (Windows) Plays Plays Plays Fails Plays Plays Plays Plays Plays Rejects Rejects Rejects Plays Plays Plays Plays Rejects Plays Testbench revision 7.
Amarok (Windows) Fails Plays Plays Crashes Plays Plays Fails Plays Skips Fails Plays Plays Plays Plays Plays Plays Fails - Amarok version 2.8.0 with testbench revision 5 and 60-63
Cog Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays - version 2169 (2169-gbf54c452) with testbench revision 6
Exaile (Windows) Plays Plays Plays Plays Fails Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays - First tested version 4.1.1 (GStreamer: 1.18.4) with testbench revision 5. Then updated with 4.1.2-beta1 (GStreamer: 1.18.5) for variable blocksize and 60-63
ffplay (Windows) Fails Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Unresp. Plays - - - version 4.4.1-essentials_build-www.gyan.dev with testbench revision 5
foobar2000 2.0 beta 7 [x86] Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Testbench revision 7
GoneMAD (Android) Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Crashes Plays Hangs Plays - - - testbench revision 5
JRiver Media Center Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Rejects Plays - - - version 28.0.88 64-bit with testbench revision 5
Mediamonkey 5 Plays Plays Plays Crashes Plays Plays Plays Plays Plays Silence Breaks Plays Plays Unresp. Plays - - - Version 5.0.1.2433 with testbench revision 5
Mplayer (Windows) Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails Plays Plays Plays Unresp. Plays Plays Fails - Version Redxii-SVN-r37955-6.2.0 (x86_64) (using ffmpeg N-87137-g6ccd32c367) with testbench revision 5 & files 60-63
mpv Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Hangs Plays Plays Fails - mpv-x86_64-20211031-git-4a80de9 on Windows, testbench revision 5 & files 60-63
Quod Libet (Windows) Plays Plays Plays Plays Fails Plays Plays Plays Skips Plays Plays Plays Plays Plays Plays Plays Plays - version 4.4.0 (portable version) with testbench revision 5 and 4.5.0 (portable) with revision 6.
Spotify (Windows) Plays Plays Plays Skips Plays Plays Plays Plays Skips Skips Skips (?) Skips (?) Plays Rejects Plays Plays Plays - Spotify for Windows version 1.1.72.439.gc253025e, testbench revision 5; files 60-63 with version 1.1.83.956.gbe7ea9a7. Note, tested a stereo soundcard only (hence the question mark on multichannel).
VLC Plays Plays Plays Plays Fails Plays Plays Plays Plays Plays Plays Plays Plays Crashes Plays Plays Plays Plays VLC 3.0.16 on testbench revision 5
VLC 3.0.17.4 on files 60 to 63.
VLC 3.0.16 on file 64
VUPlayer Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Fails VUPlayer 64-bit version 4.13 (BASS 2.4.15.0) with testbench revision 6.
Winamp 5.8 Plays Plays Plays Freezes Plays Plays Plays Plays Freezes Plays Freezes Plays Plays Plays - - - Winamp 5.8 build 3660, testbench revision 5
Windows Media Player Plays Plays Plays Rejects Plays Plays Plays Plays Plays Rejects Plays Plays Plays Rejects Plays - - - Tested version 12.0.19041.1288 on testbench revision 5
XMPlay Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays Plays XMPlay 3.8.5 with FLAC decoder revision 12 tested with testbench revision 7.
Table legend
Plays all files in this category are played as intended, without glitches, changes etc.
Rejects One or more files are rejected by the player, either by skipping the file or mentioning a message like: "file not supported"
Fails One or more files are not played back as intended, for example by stuttering, garbling or playing at incorrect speed, or by never starting playing (though not skipping, freezing or rebooting)
Freezes On one or more files, the player crashes on decoding, leaving the unit inoperable until reboot, or the unit reboots by itself
The order of precedence is from bottom to top, so if one file freezes the player, one file is rejected and the other play fine, the table reads 'Freezes' for that category.
For the metadata tests, the (absence of) rendering of the metadata is not a criterium, simply whether its presence is an obstacle to playing
Retrieved from "https://wiki.hydrogenaud.io/index.php?title=FLAC_decoder_testbench&oldid=35852"