Difference between revisions of "Hydrogenaudio Listening Tests"

From Hydrogenaudio Knowledgebase
Jump to: navigation, search
(Remove the bold table contents. NOTE: The WMA table is the pattern for all tables -- which I will fix later.)
(Make all tables uniform and clean up the wiki codes)
Line 18: Line 18:
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
−
| align="left" | 2004-12-09 || Ahead vs Apple 128-kbps<br>Classical || Guruboolez || Private
+
| style="width:064px" | 2004-12-09  
−
| iTunes 4.1.052, 4.7.042;<br>Nero 2.5.9.7, 2.9.998 CBR, 2.9.998 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=29924&view=findpost&p=258644 HA Thread]
+
| style="width:174px" | Ahead vs Apple 128-kbps<br>Classical  
 +
| style="width:101px" | Guruboolez  
 +
| style="width:045px" | Private
 +
| style="width:299px" | iTunes 4.1.052, 4.7.042;<br>Nero 2.5.9.7, 2.9.998 CBR, 2.9.998 VBR  
 +
| style="width:110px" | [http://www.hydrogenaudio.org/forums/index.php?showtopic=29924&view=findpost&p=258644 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-09-05 || 48- & 64-kbps HE-AAC<br>Classical || Guruboolez || Private
+
| 2005-09-05
−
| CT aacPlus v.2 48- & 64-kbps<br>Helix 11.0.0.1897, Nero 3.2.0.20 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36868&view=findpost&p=325091 HA Thread]
+
| 48- & 64-kbps HE-AAC<br>Classical
 +
| Guruboolez
 +
| Private
 +
| CT aacPlus v.2 48- & 64-kbps<br>Helix 11.0.0.1897, Nero 3.2.0.20 VBR
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=36868&view=findpost&p=325091 HA Thread]
 
|}
 
|}
  
Line 32: Line 40:
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
−
| align="left" | 2004-01-18 || Dithering Test (1)<br>Special || Guruboolez || Private
+
| style="width:064px" | 2004-01-18  
−
| [[MP3]] Decoders: <br>MAD, [[LAME]], Fraunhofer, foobar2000 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
+
| style="width:174px" | Dithering Test (1)<br>Special  
 +
| style="width:101px" | Guruboolez  
 +
| style="width:045px" | Private
 +
| style="width:299px" | [[MP3]] Decoders: <br>MAD, [[LAME]], Fraunhofer, foobar2000  
 +
| style="width:110px" | [http://www.hydrogenaudio.org/forums/index.php?showtopic=17728&view=findpost&p=174740 HA Thread]
 
|-
 
|-
−
| align="left" | 2004-11-15 || 130-kbps LAME<br>rjamorim || Guruboolez || Private
+
| 2004-11-15
−
| [[LAME]] 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR || [http://www.hydrogenaudio.org/forums/index.php?showtopic=29422&view=findpost&p=253968 HA Thread]
+
| 130-kbps LAME<br>rjamorim
 +
| Guruboolez
 +
| Private
 +
| [[LAME]] 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=29422&view=findpost&p=253968 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-01-11 || 128-kbps LAME<br>ff123 || Guruboolez || Private
+
| 2005-01-11
−
| [[LAME]] 3.90.3, 3.96.1, 3.97a5 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=30547&view=findpost&p=264411 HA Thread]
+
| 128-kbps LAME<br>ff123
 +
| Guruboolez
 +
| Private
 +
| [[LAME]] 3.90.3, 3.96.1, 3.97a5
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=30547&view=findpost&p=264411 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-10-17 || [[LAME]] 3.98 -V5<br>Classical || Guruboolez || Private
+
| 2005-10-17
−
| [[LAME]] 3.98: -V5, with --vbr-new,<br>add --athaa-sensitivity 1 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=37973&view=findpost&p=335086 HA Thread]
+
| [[LAME]] 3.98 -V5<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[LAME]] 3.98: -V5, -V5 --vbr-new,<br> -V5 --vbr-new --athaa-sensitivity 1
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=37973&view=findpost&p=335086 HA Thread]
 
|}
 
|}
  
Line 55: Line 79:
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
−
| align="left" | 2005-06-18 || --standard<br>Classical || Guruboolez || Private
+
| style="width:064px" | 2005-06-18  
−
| 1.01j, 1.15u || [http://www.hydrogenaudio.org/forums/index.php?showtopic=34911&view=findpost&p=306910 HA Thread]
+
| style="width:174px" | --standard<br>Classical  
 +
| style="width:101px" | Guruboolez  
 +
| style="width:045px" | Private
 +
| style="width:299px" | 1.01j, 1.15u  
 +
| style="width:110px" | [http://www.hydrogenaudio.org/forums/index.php?showtopic=34911&view=findpost&p=306910 HA Thread]
 
|}
 
|}
  
Line 66: Line 94:
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
−
| align="left" | 2003-06-18 || 128-kbps<br>ff123/rjamorim || Guruboolez || Private
+
| style="width:064px" | 2003-06-18  
−
| GT2 & PCVS || [http://www.hydrogenaudio.org/forums/index.php?showtopic=10555&view=findpost&p=106189 HA Thread]
+
| style="width:174px" | 128-kbps<br>ff123/rjamorim  
 +
| style="width:101px" | Guruboolez  
 +
| style="width:045px" | Private
 +
| style="width:299px" | GT2 & PCVS  
 +
| style="width:110px" | [http://www.hydrogenaudio.org/forums/index.php?showtopic=10555&view=findpost&p=106189 HA Thread]
 
|-
 
|-
−
| align="left" | 2004-06-17 || 160-kbps<br>Special || Guruboolez || Private
+
| 2004-06-17
−
| CVS, GT3b2, [[aoTuV]]b2, [[aoTuV]]b2+QK || [http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
+
| 160-kbps<br>Special
 +
| Guruboolez
 +
| Private
 +
| CVS, GT3b2, [[aoTuV]]b2, [[aoTuV]]b2+QK
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=22495&view=findpost&p=218681 HA Thread]
 
|-
 
|-
−
| align="left" | 2004-02-05 || -q4<br>Transients || Guruboolez || Private
+
| 2004-02-05
−
| RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=18359&view=findpost&p=180697 HA Thread]
+
| -q4<br>Transients
 +
| Guruboolez
 +
| Private
 +
| RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=18359&view=findpost&p=180697 HA Thread]
 
|}
 
|}
  
Line 97: Line 137:
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
! Date !! Title<br>Samples !! Performed by !! Type !! Codecs !! Links
 
|-
 
|-
−
| align="left" | 2003-10-11 || 130-kbps<br>Classical (Baroque) || Guruboolez || Private
+
| style="width:064px" | 2003-10-11  
−
| [[AAC]] (FAAC, PsyTel, Nero, QuickTime)<br>[[MP3]] [[LAME]] 3.90.3, [[MPC]] 1.14, [[Vorbis]] GT3b1, [[WMA]]9 Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=14091&view=findpost&p=142684 HA Thread]
+
| style="width:174px" | 130-kbps<br>Classical (Baroque)  
 +
| style="width:101px" | Guruboolez  
 +
| style="width:045px" | Private
 +
| style="width:299px" | [[AAC]] (FAAC, PsyTel, Nero, QuickTime)<br>[[MP3]] [[LAME]] 3.90.3, [[MPC]] 1.14, [[Vorbis]] GT3b1, [[WMA]]9 Pro  
 +
| style="width:110px" | [http://www.hydrogenaudio.org/forums/index.php?showtopic=14091&view=findpost&p=142684 HA Thread]
 
|-
 
|-
−
| align="left" | 2003-12-13 || 128-kbps<br>Classical || Guruboolez || Private
+
| 2003-12-13
−
| [[AAC]] (iTunes, Nero, FAAC), <br>[[Vorbis]] 1.01, [[WMA]]9, [[MP3]] [[LAME]] 3.93.1 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=16395&view=findpost&p=163116 HA Thread]
+
| 128-kbps<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[AAC]] (iTunes, Nero, FAAC), <br>[[Vorbis]] 1.01, [[WMA]]9, [[MP3]] [[LAME]] 3.93.1
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=16395&view=findpost&p=163116 HA Thread]
 
|-
 
|-
−
| align="left" | 2004-07-12 || 175-kbps<br>Classical || Guruboolez || Private
+
| 2004-07-12
−
| [[Vorbis]] Megamix -q5,50, -q5,99 -q6,00<br>[[MP3]] [[LAME]] 3.97a3 -V3, -V2, [[MPC]] -q5 ||
+
| 175-kbps<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[Vorbis]] Megamix -q5,50, -q5,99 -q6,00<br>[[MP3]] [[LAME]] 3.97a3 -V3, -V2, [[MPC]] -q5
 +
|
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=23355&view=findpost&p=225046 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=23355&view=findpost&p=225046 HA Thread]
 
|-
 
|-
−
| align="left" | 2004-12-09 || 130-kbps<br>Classical || Guruboolez || Private
+
| 2004-12-09
−
| [[AAC]] Nero 2.9.9.998<br>[[Vorbis]] aoTuVb3 ||
+
| 130-kbps<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[AAC]] Nero 2.9.9.998<br>[[Vorbis]] aoTuVb3
 +
|
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=29925&view=findpost&p=258645 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=29925&view=findpost&p=258645 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-03-05 || 140-kbps VBR<br>Classical || Guruboolez || Private
+
| 2005-03-05
−
| [[AAC]] Nero 3.0.0.4, [[Vorbis]] 1.1, QK28 ||
+
| 140-kbps VBR<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[AAC]] Nero 3.0.0.4, [[Vorbis]] 1.1, QK28
 +
|
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32080&view=findpost&p=279240 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32080&view=findpost&p=279240 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-03-17 || 256-kbps Transcode from MP3<br>subset of ff123 || Guruboolez || Private
+
| 2005-03-17
−
| [[AAC]] iTunes 4.7, [[MP3]] [[LAME]] 3.97a8<br>[[MPC]] 1.15u, [[Vorbis]] aoTuVb3, [[WavPack]] 4.2b3 Lossy ||
+
| 256-kbps Transcode from MP3<br>subset of ff123
 +
| Guruboolez
 +
| Private
 +
| [[AAC]] iTunes 4.7, [[MP3]] [[LAME]] 3.97a8<br>[[MPC]] 1.15u, [[Vorbis]] aoTuVb3, [[WavPack]] 4.2b3 Lossy
 +
|
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32440&view=findpost&p=282909 HA Thread]
 
[http://www.hydrogenaudio.org/forums/index.php?showtopic=32440&view=findpost&p=282909 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-07-11 || 80-kbps<br>Various || Guruboolez || Private
+
| 2005-07-11
−
| [[LAME]] [[MP3]], [[AAC]]-HE and -LC,<br>[[Vorbis]] [[aoTuV]], [[WMA]] Std || [http://www.hydrogenaudio.org/forums/index.php?showtopic=35438&view=findpost&p=312296 HA Thread]
+
| 80-kbps<br>Various
 +
| Guruboolez
 +
| Private
 +
| [[LAME]] [[MP3]], [[AAC]]-HE and -LC,<br>[[Vorbis]] [[aoTuV]], [[WMA]] Std
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=35438&view=findpost&p=312296 HA Thread]
 
|-
 
|-
−
| align="left" | 2005-08-22 || 180-kbps<br>Classical || Guruboolez || Private
+
| 2005-08-22
−
| [[AAC]], [[MP3]], [[MPC]], [[Vorbis]] [[aoTuV]]b4 || [http://www.hydrogenaudio.org/forums/index.php?showtopic=36465 HA Thread]
+
| 180-kbps<br>Classical
 +
| Guruboolez
 +
| Private
 +
| [[AAC]], [[MP3]], [[MPC]], [[Vorbis]] [[aoTuV]]b4
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=36465 HA Thread]
 
|-
 
|-
−
| align="left" | 2006-01-13 || 128-kbps<br>General || Sebastian Mares || Public
+
| 2006-01-13
−
| iTunes & Nero [[AAC]], [[LAME]] [[MP3]],<br>[[Vorbis]] [[aoTuV]], [[WMA]] Pro || [http://www.hydrogenaudio.org/forums/index.php?showtopic=40607&view=findpost&p=357117 HA Thread]<br>[http://www.maresweb.de/listening-tests/mf-128-1/results.htm Complete Results]
+
| 128-kbps<br>General
 +
| Sebastian Mares
 +
| Public
 +
| iTunes & Nero [[AAC]], [[LAME]] [[MP3]],<br>[[Vorbis]] [[aoTuV]], [[WMA]] Pro
 +
| [http://www.hydrogenaudio.org/forums/index.php?showtopic=40607&view=findpost&p=357117 HA Thread]<br>[http://www.maresweb.de/listening-tests/mf-128-1/results.htm Complete Results]
 
|}
 
|}
  

Revision as of 06:07, 2 February 2006

From time to time, HydrogenAudio members conducted listening tests, either public ones or private ones. These listening test should be valuable in gauging the performance of various digital audio techniques, e.g. compression, transcoding, etc., on a certain point in time.

It should be noted that these tests may become obsoleted by newer enhancements in the techniques. So please ensure that there's no newer tests before drawing conclusions.

This page contains links to Listening Tests carried out by various members of HydrogenAudio.

When you read the test results, you may happen upon many unfamiliar terminologies, especially concerning artifacts. ff123's Artifact Training Page is the place to go to understand what these 'artifacts' are all about.

Note: There are no such things as listening tests for Lossless compression. There are only performance tests (e.g. compression ration, encode/decode speed, etc). So, check out the Lossless comparison page instead.


Format-specific Tests

AAC

Date Title
Samples 		Performed by Type Codecs Links
2004-12-09 Ahead vs Apple 128-kbps
Classical 		Guruboolez Private iTunes 4.1.052, 4.7.042;
Nero 2.5.9.7, 2.9.998 CBR, 2.9.998 VBR 		HA Thread
2005-09-05 48- & 64-kbps HE-AAC
Classical 		Guruboolez Private CT aacPlus v.2 48- & 64-kbps
Helix 11.0.0.1897, Nero 3.2.0.20 VBR 		HA Thread


MP3

Date Title
Samples 		Performed by Type Codecs Links
2004-01-18 Dithering Test (1)
Special 		Guruboolez Private MP3 Decoders:
MAD, LAME, Fraunhofer, foobar2000 		HA Thread
2004-11-15 130-kbps LAME
rjamorim 		Guruboolez Private LAME 3.90.3 ABR, 3.96.1 ABR, 3.96.1 VBR HA Thread
2005-01-11 128-kbps LAME
ff123 		Guruboolez Private LAME 3.90.3, 3.96.1, 3.97a5 HA Thread
2005-10-17 LAME 3.98 -V5
Classical 		Guruboolez Private LAME 3.98: -V5, -V5 --vbr-new,
-V5 --vbr-new --athaa-sensitivity 1 		HA Thread

Notes: (1) Performed under extreme listening conditions not reproducible on daily listening.


MPC

Date Title
Samples 		Performed by Type Codecs Links
2005-06-18 --standard
Classical 		Guruboolez Private 1.01j, 1.15u HA Thread


Vorbis

Date Title
Samples 		Performed by Type Codecs Links
2003-06-18 128-kbps
ff123/rjamorim 		Guruboolez Private GT2 & PCVS HA Thread
2004-06-17 160-kbps
Special 		Guruboolez Private CVS, GT3b2, aoTuVb2, aoTuVb2+QK HA Thread
2004-02-05 -q4
Transients 		Guruboolez Private RC3 2002-03, RC3 2002-04, 1.01, 1.01 QK2 HA Thread


WMA

Date Title
Samples 		Performed by Type Codecs Links
2003-06-18 128-kbps
ff123/rjamorim 		Guruboolez Private WMA9 Standard & Pro HA Thread

Multiformat Tests

Date Title
Samples 		Performed by Type Codecs Links
2003-10-11 130-kbps
Classical (Baroque) 		Guruboolez Private AAC (FAAC, PsyTel, Nero, QuickTime)
MP3 LAME 3.90.3, MPC 1.14, Vorbis GT3b1, WMA9 Pro 		HA Thread
2003-12-13 128-kbps
Classical 		Guruboolez Private AAC (iTunes, Nero, FAAC),
Vorbis 1.01, WMA9, MP3 LAME 3.93.1 		HA Thread
2004-07-12 175-kbps
Classical 		Guruboolez Private Vorbis Megamix -q5,50, -q5,99 -q6,00
MP3 LAME 3.97a3 -V3, -V2, MPC -q5

HA Thread

2004-12-09 130-kbps
Classical 		Guruboolez Private AAC Nero 2.9.9.998
Vorbis aoTuVb3

HA Thread

2005-03-05 140-kbps VBR
Classical 		Guruboolez Private AAC Nero 3.0.0.4, Vorbis 1.1, QK28

HA Thread

2005-03-17 256-kbps Transcode from MP3
subset of ff123 		Guruboolez Private AAC iTunes 4.7, MP3 LAME 3.97a8
MPC 1.15u, Vorbis aoTuVb3, WavPack 4.2b3 Lossy

HA Thread

2005-07-11 80-kbps
Various 		Guruboolez Private LAME MP3, AAC-HE and -LC,
Vorbis aoTuV, WMA Std 		HA Thread
2005-08-22 180-kbps
Classical 		Guruboolez Private AAC, MP3, MPC, Vorbis aoTuVb4 HA Thread
2006-01-13 128-kbps
General 		Sebastian Mares Public iTunes & Nero AAC, LAME MP3,
Vorbis aoTuV, WMA Pro 		HA Thread
Complete Results


External Tests

Other people also held listening tests outside of Hydrogenaudio (although the organizer of the tests are usually HA members :)

So, check out the following sites:

Retrieved from "https://wiki.hydrogenaud.io/index.php?title=Hydrogenaudio_Listening_Tests&oldid=10090"