<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>
<channel>
	<title>Comments on: Consumer Reports Responds</title>
	<atom:link href="http://toolmonger.com/2009/06/26/consumer-reports-responds/feed/" rel="self" type="application/rss+xml" />
	<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/</link>
	<description>All tools. All the time.  Your source for news, information, and reviews of hand tools, power tools, and tools of all kinds.</description>
	<pubDate>Sun, 22 Nov 2009 17:37:20 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.6.1</generator>
		<item>
		<title>By: markwlewis</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-981809</link>
		<dc:creator>markwlewis</dc:creator>
		<pubDate>Fri, 03 Jul 2009 16:51:39 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-981809</guid>
		<description>Look, Consumer Reports is not perfect. They know it. these days companies can make a perfectly fine product one year and a pizzakrap the next. Example: I have been working on a dryer for weeks and months. 

It is a Kenmore/Whirlpool. It has a solid state control panel that was (gently put) problematic. (Less gently, a poorly engineered pizzacrap.) I am not sure how CR testing could have seen this coming as it has taken years for people to realize what a pizzacrap it really is and the large pool of machines that are covered by that hard fact! (You can do a search if you are curious.)

 Noteworthy NOW at this late date is that most every dryer (not in the pricing stratosphere) has MOSTLY MECHANICAL controls. I kid you not, I have seen a hundred or more dryers 800 dollars and below and NONE had a single integrated control panel (one piece) like those multitude of machines that were produced for 3-4 years. No shorter-term testing would point that out, and CR could not be blamed for that. SO the tyranny of the masses still has a VALUE, but not so much in immediate purchase feedback. I have had people giving top ratings to durable goods when they had them LESS THAN A WEEK! 

Ummm, thanks but no, you can't tell me what a terrific vacuum a certain model is in one week without qualifying it by saying "Of course in a month I may think it is a pizzacrap when it stops working 3 times and breaks the belt twice." 

But, the ratings are still compiled, say on Amazon, as if this review of a "real user" is an across the board endorsement, "Hey, these people think it deserves 5 stars!" This info in valid, but most so when combined with a more methodical approach like testing something to the point of failure, which, honestly, I ain't doing, at least not on purpose (lol). 

That is what CA does and I appreciate getting both opinions. Even the historical reliability rating help, but cannot be counted on as the last word. The company that got low marks last year, may have been absorbed by a BETTER QUALITY competitor and now be making products of increased quality! (Let me have my DREAM, you jackals!)</description>
		<content:encoded><![CDATA[<p>Look, Consumer Reports is not perfect. They know it. these days companies can make a perfectly fine product one year and a pizzakrap the next. Example: I have been working on a dryer for weeks and months. </p>
<p>It is a Kenmore/Whirlpool. It has a solid state control panel that was (gently put) problematic. (Less gently, a poorly engineered pizzacrap.) I am not sure how CR testing could have seen this coming as it has taken years for people to realize what a pizzacrap it really is and the large pool of machines that are covered by that hard fact! (You can do a search if you are curious.)</p>
<p> Noteworthy NOW at this late date is that most every dryer (not in the pricing stratosphere) has MOSTLY MECHANICAL controls. I kid you not, I have seen a hundred or more dryers 800 dollars and below and NONE had a single integrated control panel (one piece) like those multitude of machines that were produced for 3-4 years. No shorter-term testing would point that out, and CR could not be blamed for that. SO the tyranny of the masses still has a VALUE, but not so much in immediate purchase feedback. I have had people giving top ratings to durable goods when they had them LESS THAN A WEEK! </p>
<p>Ummm, thanks but no, you can&#8217;t tell me what a terrific vacuum a certain model is in one week without qualifying it by saying &#8220;Of course in a month I may think it is a pizzacrap when it stops working 3 times and breaks the belt twice.&#8221; </p>
<p>But, the ratings are still compiled, say on Amazon, as if this review of a &#8220;real user&#8221; is an across the board endorsement, &#8220;Hey, these people think it deserves 5 stars!&#8221; This info in valid, but most so when combined with a more methodical approach like testing something to the point of failure, which, honestly, I ain&#8217;t doing, at least not on purpose (lol). </p>
<p>That is what CA does and I appreciate getting both opinions. Even the historical reliability rating help, but cannot be counted on as the last word. The company that got low marks last year, may have been absorbed by a BETTER QUALITY competitor and now be making products of increased quality! (Let me have my DREAM, you jackals!)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Toolmonger &#187; Blog Archive &#187; The Week in Tools: Toolmonger Top 5</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-981678</link>
		<dc:creator>Toolmonger &#187; Blog Archive &#187; The Week in Tools: Toolmonger Top 5</dc:creator>
		<pubDate>Fri, 03 Jul 2009 14:34:10 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-981678</guid>
		<description>[...] Consumer Reports Responds After reading Kevin Pace’s Hot or Not? Consumer Reports post — and the great comments it’s generated — our friend Bob Markovich over at Consumer Reports dropped us a line to respond. Read on past the jump to read his note we received last week: [...]</description>
		<content:encoded><![CDATA[<p>[...] Consumer Reports Responds After reading Kevin Pace’s Hot or Not? Consumer Reports post — and the great comments it’s generated — our friend Bob Markovich over at Consumer Reports dropped us a line to respond. Read on past the jump to read his note we received last week: [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bob Markovich</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-979481</link>
		<dc:creator>Bob Markovich</dc:creator>
		<pubDate>Wed, 01 Jul 2009 13:51:21 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-979481</guid>
		<description>Appreciate all the comments on my comments. One other word about one comment that insists our overall scores include a price or value quotient: They don't. Period. But, yes, our picks and certainly our CR Best Buys take price and reliability into account, as they should.</description>
		<content:encoded><![CDATA[<p>Appreciate all the comments on my comments. One other word about one comment that insists our overall scores include a price or value quotient: They don&#8217;t. Period. But, yes, our picks and certainly our CR Best Buys take price and reliability into account, as they should.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: frankoamerican</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-978405</link>
		<dc:creator>frankoamerican</dc:creator>
		<pubDate>Tue, 30 Jun 2009 12:36:53 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-978405</guid>
		<description>The take-away message about CR testing paints outdoors 24/7 is that it is real world testing--not simulated in a laboratory environmental chamber.

For what it's worth, and I swear on a stack of woodworking magazines that I'm not a shill from CR but a chemist, the testing they do is first rate.  Their experimental procedures and attention to detail is impressive.  Remember, though, that there's aways a critic, no matter what you do.</description>
		<content:encoded><![CDATA[<p>The take-away message about CR testing paints outdoors 24/7 is that it is real world testing&#8211;not simulated in a laboratory environmental chamber.</p>
<p>For what it&#8217;s worth, and I swear on a stack of woodworking magazines that I&#8217;m not a shill from CR but a chemist, the testing they do is first rate.  Their experimental procedures and attention to detail is impressive.  Remember, though, that there&#8217;s aways a critic, no matter what you do.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dexm</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-975054</link>
		<dc:creator>Dexm</dc:creator>
		<pubDate>Sun, 28 Jun 2009 11:12:59 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-975054</guid>
		<description>I like what the guy from CR wrote here.  I think it's a salient observation on reviews found on the net:

&#62;&#62;    We also verify that no one is stuffing the ballot box with multiple questionnaires. &#62;&#62; In contrast, user reviews ARE self-selecting and tend to reflect extremes on the &#62;&#62; satisfaction scale—and you don’t always know whether the writer is an actual
 &#62;&#62; consumer or a company shill. But those reviews are an increasingly relevant leg 
&#62;&#62;  on the stool, which is why we’re looking to grow them on our site, with the above &#62;&#62;  caveats</description>
		<content:encoded><![CDATA[<p>I like what the guy from CR wrote here.  I think it&#8217;s a salient observation on reviews found on the net:</p>
<p>&gt;&gt;    We also verify that no one is stuffing the ballot box with multiple questionnaires. &gt;&gt; In contrast, user reviews ARE self-selecting and tend to reflect extremes on the &gt;&gt; satisfaction scale—and you don’t always know whether the writer is an actual<br />
 &gt;&gt; consumer or a company shill. But those reviews are an increasingly relevant leg<br />
&gt;&gt;  on the stool, which is why we’re looking to grow them on our site, with the above &gt;&gt;  caveats</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Aaron J.</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-974839</link>
		<dc:creator>Aaron J.</dc:creator>
		<pubDate>Sun, 28 Jun 2009 04:05:10 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-974839</guid>
		<description>Wanted to add to the above comment on using the ever popular Google. 

Try searching for the product with the work sucks in the form of a phrase such as:

the dremel tool sucks, Craftsman sucks, lowes sucks, toolmonger sucks ;)

You can probably find someone using that phrase for even the best products out there but the real score here is that it filters out the dozens of portal sites that come up with you try and find ratings and reviews. 
You know, the ones that just have reviews of the web store selling the product. 
And obviously if you find lots and lots of people complaining about your product that's gotta tell you something.</description>
		<content:encoded><![CDATA[<p>Wanted to add to the above comment on using the ever popular Google. </p>
<p>Try searching for the product with the work sucks in the form of a phrase such as:</p>
<p>the dremel tool sucks, Craftsman sucks, lowes sucks, toolmonger sucks <img src='http://toolmonger.com/wp-includes/images/smilies/icon_wink.gif' alt=';)' class='wp-smiley' /> </p>
<p>You can probably find someone using that phrase for even the best products out there but the real score here is that it filters out the dozens of portal sites that come up with you try and find ratings and reviews.<br />
You know, the ones that just have reviews of the web store selling the product.<br />
And obviously if you find lots and lots of people complaining about your product that&#8217;s gotta tell you something.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Zathrus</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-973545</link>
		<dc:creator>Zathrus</dc:creator>
		<pubDate>Fri, 26 Jun 2009 20:28:15 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-973545</guid>
		<description>@tooldork:

Which proves what? Nothing... it merely means that the full scoring strategy is not printed and that your attempt to "decode" it was a failure. They do not print the full scoring methodology or break it out on individual products. The bubbles are not meant to be a hard and fast number, but a general indicator of how a product performed in that area. One "excellent" is not equivalent to another "excellent".

@Jim German:

Given, it's a duh, but what other publications or review sites do anything even close? The real issue is that by the time the 3 years are done and the report is published you have no way of getting the exact formulation that was tested... and from looking at year-to-year tests, it's pretty common that a paint/stain that rated top one year will be average or even below average the next. Some are repeatedly in the top quarter though, so you can pick any of those and feel pretty good about it.


And to the original article:
"Our brand-repair surveys aren’t self-selecting or warranty-based. We invite millions of subscribers via regular mail and online to answer questions"

Oops. You're right -- I blew the definition of a "self selected survey" there. The real question, however, is what is the response rate on your solicitations to participate?</description>
		<content:encoded><![CDATA[<p>@tooldork:</p>
<p>Which proves what? Nothing&#8230; it merely means that the full scoring strategy is not printed and that your attempt to &#8220;decode&#8221; it was a failure. They do not print the full scoring methodology or break it out on individual products. The bubbles are not meant to be a hard and fast number, but a general indicator of how a product performed in that area. One &#8220;excellent&#8221; is not equivalent to another &#8220;excellent&#8221;.</p>
<p>@Jim German:</p>
<p>Given, it&#8217;s a duh, but what other publications or review sites do anything even close? The real issue is that by the time the 3 years are done and the report is published you have no way of getting the exact formulation that was tested&#8230; and from looking at year-to-year tests, it&#8217;s pretty common that a paint/stain that rated top one year will be average or even below average the next. Some are repeatedly in the top quarter though, so you can pick any of those and feel pretty good about it.</p>
<p>And to the original article:<br />
&#8220;Our brand-repair surveys aren’t self-selecting or warranty-based. We invite millions of subscribers via regular mail and online to answer questions&#8221;</p>
<p>Oops. You&#8217;re right &#8212; I blew the definition of a &#8220;self selected survey&#8221; there. The real question, however, is what is the response rate on your solicitations to participate?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Barri</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-973516</link>
		<dc:creator>Barri</dc:creator>
		<pubDate>Fri, 26 Jun 2009 19:20:55 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-973516</guid>
		<description>I think the best way to find out the quality of a product is GOOGLE it. You will find more honest reviews of products than you could ever find in a mag. If a high % of reviews are good you know your buying a good product. Simple and it has worked for me for over 10 years.</description>
		<content:encoded><![CDATA[<p>I think the best way to find out the quality of a product is GOOGLE it. You will find more honest reviews of products than you could ever find in a mag. If a high % of reviews are good you know your buying a good product. Simple and it has worked for me for over 10 years.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jim German</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-973500</link>
		<dc:creator>Jim German</dc:creator>
		<pubDate>Fri, 26 Jun 2009 18:40:11 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-973500</guid>
		<description>"exterior paints for a full three years outdoors 24/7"  Ohh well thats great to hear, since I know I don't bring my siding in at night or on the weekends.
*eyeroll*

Until Consumer Reports gives a detailed breakdown on how they score products (something at least as good as car and driver does for their scores), their ratings will be pretty much useless.</description>
		<content:encoded><![CDATA[<p>&#8220;exterior paints for a full three years outdoors 24/7&#8243;  Ohh well thats great to hear, since I know I don&#8217;t bring my siding in at night or on the weekends.<br />
*eyeroll*</p>
<p>Until Consumer Reports gives a detailed breakdown on how they score products (something at least as good as car and driver does for their scores), their ratings will be pretty much useless.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: tooldork</title>
		<link>http://toolmonger.com/2009/06/26/consumer-reports-responds/#comment-973492</link>
		<dc:creator>tooldork</dc:creator>
		<pubDate>Fri, 26 Jun 2009 18:22:07 +0000</pubDate>
		<guid isPermaLink="false">http://toolmonger.com/?p=26260#comment-973492</guid>
		<description>"We don’t rate products based on price." 

I respectfully disagree.

I did analysis on their ratings for composite decking products and translated ratings to numeric values to try to dissect the overall rating value.

10 = excellent 
9 = very good 
8 = good 
7 = fair
6= poor

Based on ratings, not one product equaled the overall score for their product. But, when comparing two products with equal rating scores, those with lower ratings scores, that were priced lower, were bumped up to reach a higher overall score.</description>
		<content:encoded><![CDATA[<p>&#8220;We don’t rate products based on price.&#8221; </p>
<p>I respectfully disagree.</p>
<p>I did analysis on their ratings for composite decking products and translated ratings to numeric values to try to dissect the overall rating value.</p>
<p>10 = excellent<br />
9 = very good<br />
8 = good<br />
7 = fair<br />
6= poor</p>
<p>Based on ratings, not one product equaled the overall score for their product. But, when comparing two products with equal rating scores, those with lower ratings scores, that were priced lower, were bumped up to reach a higher overall score.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
