Difference between revisions of "Hydrogenaudio Listening Tests"

From Hydrogenaudio Knowledgebase
Jump to: navigation, search
(Added all guru's tests. Remove stub template)
(Some table fixups)
Line 11: Line 11:
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 
|- style="background:#ff2222"
 
|- style="background:#ff2222"
! Date !! Title !! Performed by !! Type !! Codecs !! Links
+
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2004-01-18 || 128-kbps Classic || Guruboolez || Private
+
! align="left" | 2004-01-18 || 128-kbps<br>Classical || Guruboolez || Private
 
| iTunes 4.1.052, iTunes 4.7.042, Nero 2.5.9.7<br>Nero 2.9.998 CBR, Nero 2.9.998 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=29924&view=findpost&p=258644 HA Thread]
 
| iTunes 4.1.052, iTunes 4.7.042, Nero 2.5.9.7<br>Nero 2.9.998 CBR, Nero 2.9.998 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=29924&view=findpost&p=258644 HA Thread]
 
|-
 
|-
! align="left" | 2005-09-05 || 48- & 64-kbps HE-AAC Classic || Guruboolez || Private
+
! align="left" | 2005-09-05 || 48- & 64-kbps HE-AAC<br>Classical || Guruboolez || Private
 
| CT aacPlus v.2 48- & 64-kbps<br>Helix 11.0.0.1897, Nero 3.2.0.20 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36868&view=findpost&p=325091 HA Thread]
 
| CT aacPlus v.2 48- & 64-kbps<br>Helix 11.0.0.1897, Nero 3.2.0.20 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36868&view=findpost&p=325091 HA Thread]
 
|}
 
|}
Line 25: Line 25:
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 
|- style="background:#2222ff"
 
|- style="background:#2222ff"
! Date !! Title !! Performed by !! Type !! Codecs !! Links
+
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2004-01-18 || Dithering Test (1) || Guruboolez || Private
+
! align="left" | 2004-01-18 || Dithering Test (1)<br>Special || Guruboolez || Private
 
| [[MP3]] Decoders: <br>MAD, [[LAME]], Fraunhofer, foobar2000 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
 
| [[MP3]] Decoders: <br>MAD, [[LAME]], Fraunhofer, foobar2000 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
 
|-
 
|-
! align="left" | 2004-11-15 || 130-kbps rjamorim || Guruboolez || Private
+
! align="left" | 2004-11-15 || 130-kbps LAME<br>rjamorim || Guruboolez || Private
 
| [[LAME]] 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
 
| [[LAME]] 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
 
|-
 
|-
! align="left" | 2005-01-11 || 128-kbps ff123 || Guruboolez || Private
+
! align="left" | 2005-01-11 || 128-kbps LAME<br>ff123 || Guruboolez || Private
 
| [[LAME]] 3.90.3, 3.96.1, 3.97a5 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=30547&view=findpost&p=264411 HA Thread]
 
| [[LAME]] 3.90.3, 3.96.1, 3.97a5 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=30547&view=findpost&p=264411 HA Thread]
 
|-
 
|-
! align="left" | 2005-10-17 || -V5 Classical || Guruboolez || Private
+
! align="left" | 2005-10-17 || -V5<br>Classical || Guruboolez || Private
 
| [[LAME]] 3.98: -V5, with --vbr-new,<br>add --athaa-sensitivity 1 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=37973&view=findpost&p=335086 HA Thread]
 
| [[LAME]] 3.98: -V5, with --vbr-new,<br>add --athaa-sensitivity 1 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=37973&view=findpost&p=335086 HA Thread]
 
|}
 
|}
Line 50: Line 50:
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2005-06-18 || --standard Classical || Guruboolez || Private
+
! align="left" | 2005-06-18 || --standard<br>Classical || Guruboolez || Private
 
| 1.01j, 1.15u || [http://www.hydrogenaudio.org/forums/index.php?showtopic=34911&view=findpost&p=306910 HA Thread]
 
| 1.01j, 1.15u || [http://www.hydrogenaudio.org/forums/index.php?showtopic=34911&view=findpost&p=306910 HA Thread]
 
|}
 
|}
 
  
  
Line 62: Line 61:
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2004-06-17 || 160-kbps Special || Guruboolez || Private
+
! align="left" | 2003-06-18 || 128-kbps<br>ff123/rjamorim || Guruboolez || Private
 +
| [[Vorbis]] GT2 & PCVS || [http://www.hydrogenaudio.org/forums/index.php?showtopic=10555&view=findpost&p=106189 HA Thread]
 +
|-
 +
! align="left" | 2004-06-17 || 160-kbps<br>Special || Guruboolez || Private
 
| CVS, GT3b2, [[aoTuV]]b2, [[aoTuV]]b2+QK || [http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
 
| CVS, GT3b2, [[aoTuV]]b2, [[aoTuV]]b2+QK || [http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
 
|-
 
|-
! align="left" | 2004-02-05 || -q4 Transients || Guruboolez || Private
+
! align="left" | 2004-02-05 || -q4<br>Transients || Guruboolez || Private
 
| RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=18359&view=findpost&p=180697 HA Thread]
 
| RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=18359&view=findpost&p=180697 HA Thread]
 
|}
 
|}
  
  
=Comparison Tests=
+
==[[WMA]]==
  
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
|- style="background:#22ff22"
+
|- style="background:#ffff22"
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2003-06-18 || 128-kbps ff123/rjamorim || Guruboolez || Private
+
! align="left" | 2003-06-18 || 128-kbps<br>ff123/rjamorim || Guruboolez || Private
| [[Vorbis]] GT2 & PCVS || [http://www.hydrogenaudio.org/forums/index.php?showtopic=10555&view=findpost&p=106189 HA Thread]
+
|-
+
! align="left" | 2003-06-18 || 128-kbps ff123/rjamorim || Guruboolez || Private
+
 
| [[WMA]]9 Standard & Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=10551&view=findpost&p=106158 HA Thread]
 
| [[WMA]]9 Standard & Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=10551&view=findpost&p=106158 HA Thread]
 +
|}
 +
 +
 +
=Comparison Tests=
 +
 +
{| border="1" cellpadding="2" cellspacing="0" style="text-align:center;"
 +
|- style="background:#22ff22"
 +
! Date !! Title !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
! align="left" | 2003-10-11 || 130-kbps Classical || Guruboolez || Private
+
! align="left" | 2003-10-11 || 130-kbps<br>Classical || Guruboolez || Private
 
| [[AAC]] (FAAC, PsyTel, Nero, QuickTime)<br>[[MP3]] [[LAME]], [[MPC]], [[Vorbis]] CVS, [[WMA]]9 Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=14091&view=findpost&p=142684 HA Thread]
 
| [[AAC]] (FAAC, PsyTel, Nero, QuickTime)<br>[[MP3]] [[LAME]], [[MPC]], [[Vorbis]] CVS, [[WMA]]9 Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=14091&view=findpost&p=142684 HA Thread]
 
|-
 
|-
! align="left" | 2003-12-13 || 128-kbps Classical || Guruboolez || Private
+
! align="left" | 2003-12-13 || 128-kbps<br>Classical || Guruboolez || Private
| [[AAC]] (QuickTime, Nero, FAAC), [[Vorbis]] 1.01, [[WMA]]9, [[MP3]] [[LAME]] || [http://www.hydrogenaudio.org/forums/index.php?showtopic=16395&view=findpost&p=163116 HA Thread]
+
| [[AAC]] (QuickTime, Nero, FAAC), <br>[[Vorbis]] 1.01, [[WMA]]9, [[MP3]] [[LAME]] || [http://www.hydrogenaudio.org/forums/index.php?showtopic=16395&view=findpost&p=163116 HA Thread]
 
|-
 
|-
! align="left" | 2004-07-12 || 175-kbps Classical || Guruboolez || Private
+
! align="left" | 2004-07-12 || 175-kbps<br>Classical || Guruboolez || Private
 
| [[Vorbis]] Megamix -q5,50, -q5,99 -q6,00<br>[[MP3]] [[LAME]] 3.97a3 -V3, -V2, [[MPC]] -q5 ||
 
| [[Vorbis]] Megamix -q5,50, -q5,99 -q6,00<br>[[MP3]] [[LAME]] 3.97a3 -V3, -V2, [[MPC]] -q5 ||
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
 
|-
 
|-
! align="left" | 2004-12-09 || 130-kbps Classical || Guruboolez || Private
+
! align="left" | 2004-12-09 || 130-kbps<br>Classical || Guruboolez || Private
 
| [[AAC]] Nero 2.9.9.998<br>[[Vorbis]] aoTuVb3 ||
 
| [[AAC]] Nero 2.9.9.998<br>[[Vorbis]] aoTuVb3 ||
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=29925&view=findpost&p=258645 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=29925&view=findpost&p=258645 HA Thread]
 
|-
 
|-
! align="left" | 2005-03-05 || 140-kbps VBR Classical || Guruboolez || Private
+
! align="left" | 2005-03-05 || 140-kbps VBR<br>Classical || Guruboolez || Private
 
| [[AAC]] Nero 3.0.0.4, [[Vorbis]] 1.1, QK28 ||
 
| [[AAC]] Nero 3.0.0.4, [[Vorbis]] 1.1, QK28 ||
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32080&view=findpost&p=279240 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32080&view=findpost&p=279240 HA Thread]
 
|-
 
|-
! align="left" | 2005-03-17 || 256-kbps Transcoding (sub-ff123) || Guruboolez || Private
+
! align="left" | 2005-03-17 || 256-kbps Transcoding<br>subset of ff123 || Guruboolez || Private
 
| [[AAC]] iTunes 4.7, [[MP3]] [[LAME]] 3.97a8<br>[[MPC]] 1.15u, [[Vorbis]] aoTuVb3, [[WavPack]] 4.2b3 Lossy ||
 
| [[AAC]] iTunes 4.7, [[MP3]] [[LAME]] 3.97a8<br>[[MPC]] 1.15u, [[Vorbis]] aoTuVb3, [[WavPack]] 4.2b3 Lossy ||
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32440&view=findpost&p=282909 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32440&view=findpost&p=282909 HA Thread]
 
|-
 
|-
! align="left" | 2005-07-11 || 80-kbps Various || Guruboolez || Private
+
! align="left" | 2005-07-11 || 80-kbps<br>Various || Guruboolez || Private
 
| [[LAME]] [[MP3]], [[AAC]]-HE and -LC,<br>[[Vorbis]] [[aoTuV]], [[WMA]] Std || [http://www.hydrogenaudio.org/forums/index.php?showtopic=35438&view=findpost&p=312296 HA Thread]
 
| [[LAME]] [[MP3]], [[AAC]]-HE and -LC,<br>[[Vorbis]] [[aoTuV]], [[WMA]] Std || [http://www.hydrogenaudio.org/forums/index.php?showtopic=35438&view=findpost&p=312296 HA Thread]
 
|-
 
|-
! align="left" | 2005-08-22 || 180-kbps Classical || Guruboolez || Private
+
! align="left" | 2005-08-22 || 180-kbps<br>Classical || Guruboolez || Private
 
| [[AAC]], [[MP3]], [[MPC]], [[Vorbis]] [[aoTuV]]b4 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36465 HA Thread]
 
| [[AAC]], [[MP3]], [[MPC]], [[Vorbis]] [[aoTuV]]b4 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36465 HA Thread]
 
|-
 
|-
! align="left" | 2006-01-13 || 128-kbps General || Sebastian Mares || Public
+
! align="left" | 2006-01-13 || 128-kbps<br>General || Sebastian Mares || Public
| iTunes & Nero [[AAC]], [[LAME]] [[MP3]], [[Vorbis]] [[aoTuV]], [[WMA]] Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=40607&view=findpost&p=357117 HA Thread]<br>[http://www.maresweb.de/listening-tests/mf-128-1/results.htm Complete Results]
+
| iTunes & Nero [[AAC]], [[LAME]] [[MP3]],<br>[[Vorbis]] [[aoTuV]], [[WMA]] Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=40607&view=findpost&p=357117 HA Thread]<br>[http://www.maresweb.de/listening-tests/mf-128-1/results.htm Complete Results]
 
|}
 
|}
  

Revision as of 12:52, 26 January 2006

From time to time, HydrogenAudio members conducted listening tests, either public ones or private ones. These listening test should be valuable in gauging the performance of various digital audio techniques, e.g. compression, transcoding, etc., on a certain point in time.

It should be noted that these tests may become obsoleted by newer enhancements in the techniques. So please ensure that there's no newer tests before drawing conclusions.

This page contains links to Listening Tests carried out by various members of HydrogenAudio.

Format-specific Tests

AAC

Date Title
Samples
Performed by Type Codecs Links
2004-01-18 128-kbps
Classical
Guruboolez Private iTunes 4.1.052, iTunes 4.7.042, Nero 2.5.9.7
Nero 2.9.998 CBR, Nero 2.9.998 VBR
HA Thread
2005-09-05 48- & 64-kbps HE-AAC
Classical
Guruboolez Private CT aacPlus v.2 48- & 64-kbps
Helix 11.0.0.1897, Nero 3.2.0.20 VBR
HA Thread


MP3

Date Title
Samples
Performed by Type Codecs Links
2004-01-18 Dithering Test (1)
Special
Guruboolez Private MP3 Decoders:
MAD, LAME, Fraunhofer, foobar2000
HA Thread
2004-11-15 130-kbps LAME
rjamorim
Guruboolez Private LAME 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR HA Thread
2005-01-11 128-kbps LAME
ff123
Guruboolez Private LAME 3.90.3, 3.96.1, 3.97a5 HA Thread
2005-10-17 -V5
Classical
Guruboolez Private LAME 3.98: -V5, with --vbr-new,
add --athaa-sensitivity 1
HA Thread

Notes: (1) Performed under extreme listening conditions not reproducible on daily listening.


MPC

Date Title Performed by Type Codecs Links
2005-06-18 --standard
Classical
Guruboolez Private 1.01j, 1.15u HA Thread


Vorbis

Date Title Performed by Type Codecs Links
2003-06-18 128-kbps
ff123/rjamorim
Guruboolez Private Vorbis GT2 & PCVS HA Thread
2004-06-17 160-kbps
Special
Guruboolez Private CVS, GT3b2, aoTuVb2, aoTuVb2+QK HA Thread
2004-02-05 -q4
Transients
Guruboolez Private RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2 HA Thread


WMA

Date Title Performed by Type Codecs Links
2003-06-18 128-kbps
ff123/rjamorim
Guruboolez Private WMA9 Standard & Pro HA Thread


Comparison Tests

Date Title Performed by Type Codecs Links
2003-10-11 130-kbps
Classical
Guruboolez Private AAC (FAAC, PsyTel, Nero, QuickTime)
MP3 LAME, MPC, Vorbis CVS, WMA9 Pro
HA Thread
2003-12-13 128-kbps
Classical
Guruboolez Private AAC (QuickTime, Nero, FAAC),
Vorbis 1.01, WMA9, MP3 LAME
HA Thread
2004-07-12 175-kbps
Classical
Guruboolez Private Vorbis Megamix -q5,50, -q5,99 -q6,00
MP3 LAME 3.97a3 -V3, -V2, MPC -q5

HA Thread

2004-12-09 130-kbps
Classical
Guruboolez Private AAC Nero 2.9.9.998
Vorbis aoTuVb3

HA Thread

2005-03-05 140-kbps VBR
Classical
Guruboolez Private AAC Nero 3.0.0.4, Vorbis 1.1, QK28

HA Thread

2005-03-17 256-kbps Transcoding
subset of ff123
Guruboolez Private AAC iTunes 4.7, MP3 LAME 3.97a8
MPC 1.15u, Vorbis aoTuVb3, WavPack 4.2b3 Lossy

HA Thread

2005-07-11 80-kbps
Various
Guruboolez Private LAME MP3, AAC-HE and -LC,
Vorbis aoTuV, WMA Std
HA Thread
2005-08-22 180-kbps
Classical
Guruboolez Private AAC, MP3, MPC, Vorbis aoTuVb4 HA Thread
2006-01-13 128-kbps
General
Sebastian Mares Public iTunes & Nero AAC, LAME MP3,
Vorbis aoTuV, WMA Pro
HA Thread
Complete Results


External Tests

Other people also held listening tests outside of Hydrogenaudio (although the organizer of the tests are usually HA members :)

So, check out the following sites: