Consumer Reports Ranking: MINI Down
CU uses very sound testing methods and procedures in probably every comparison/testing category. If you are looking for an appliance, television, house paint or even vehicle, their tests will generally pick the highest performer, the best bang for the buck, and those that you should avoid. In relating reliability figures on items, especially cars, their tight control of testing methods gives way to using surveys from the public. While generally accurate, there can be cases of public bias or perception skewing the resutls one way or another, but the surveys themselves try to leave opinions out and cold facts in place. MINI owners (based on postings here on NAM by members) would undoubtedly nitpick the slightest flaws, where someone with a Honda might not. This can skew the ratings accordingly.
Therein lies the big issue with CR. People tend to get testy when something they feel strongly about gets reduced to simply facts, figures and ratings.
Therein lies the big issue with CR. People tend to get testy when something they feel strongly about gets reduced to simply facts, figures and ratings.
My understanding of statistical surveys is that to get an opinion that is reflective of real conditions, the process must sample an adequate percentage of the population who are owners of a product. So one question to entertain is whether that was done. Since the number of Minis sold is quite small in comparison to other makes of high volume cars, the sampling results may be premature, and more time could yield a different answer. Another point I like to remember is this is a performance machine, and it's not exactly the situation of comparing apples to apples for CR to do this type of comparitive analysis. And finally I don't like to think of a Mini in terms of a daily reliable driver. I remember older cars in the 50s or 60s that had multiple carbs that one might say were 'unreliable', but were powerful to drive. And those who like power, well enough.
"CU uses very sound testing methods and procedures in probably every comparison/testing category. If you are looking for an appliance, television, house paint or even vehicle, their tests will generally pick the highest performer, the best bang for the buck, and those that you should avoid."
Disagree.
I've been selling a/v gear for 30 years and CR is usually so far off the mark when it comes to recommending TVs, DVD players, receivers, etc. its ridiculous. Heck, it wasn't until recently that they actually started listening to the equipment to form their judgments ...they actually recommended gear based on the specs for years!
dean.
Disagree.
I've been selling a/v gear for 30 years and CR is usually so far off the mark when it comes to recommending TVs, DVD players, receivers, etc. its ridiculous. Heck, it wasn't until recently that they actually started listening to the equipment to form their judgments ...they actually recommended gear based on the specs for years!
dean.
I've found CU to be useful in the past. Their strong points to me are the reliability data and safety concerns. That being said, they have gone too far on some issues and the usability data is to a large degree just opinion. Just my opinion, for what it's worth.
says something "bad" about the MINI and all hell breaks loose
When it comes to A/V gear, you've stepped well into subjective territory when one could reasonably assume that using specifications (and more importantly, taking direct measurements to verify those specs) would rule the roost. You can line up a bunch of receivers, feed them test signals, measure output power and THD, freq response, the whole battery of tests and come up with the best of the lot in terms of 'the most accurate sound reproduction'. Yet when you take these units out of objective testing and place them in a listening room, the 'winning' unit might be lacking compared to others. Likewise, a television can offer decent resolution and accurate color reproduction in direct measurements, but not look all the great in real world performance. I still stand behind my claim of their testing methods being overall sound, but most people should know that at one point you have to stop comparing raw numbers and start sampling things in real life. THis is easy to do with cars, televisions, audio gear, since all of these things are available for hands-on experience and comparison. It's not so easy with things like paint and appliances. In the case of the former, one does not generally spend a great deal of money for the product, but that product goes through a labor intensive process to apply, and once done, the quality of that product is measured by it's fade resistance, longevity, durability, etc. CU's testing methods for paint result in a pretty good indicator for how long that paint will last in a typical application. There is no way for one to easily comparison shop for paint, and you wont know of your success until a few years down the road.
In the case of appliances, it's not like one can walk into an appliance store with a loaf of Wonder bread and start testing the various toasters. Nor can one bring a load of laundry and try every washer/dryer combo. CU has come up with decent, real-world testing to rate the functionality of various appliances and whatnot and come up with rankings. Some are more subjective, like taste-testing canned hams. But anytime you subject something to testing, you basically reduce whatever that item is to it's functionality. When CU tests cars, they pit one model against another, do acceleration, braking and handling tests, judge the ease of use of controls and displays, measure cargo capacities and headroom in the back sets, etc. There is no category for how one car makes one feel when driving, though there are usually driving impressions noted. They might say an engine might be a bit noisy and use that as a strike against that car, but to some, that noise would be something desirable, like supercharger whine.
The more a particular item elicits a passion in the owner, the harder it is to objectlively reduce that passion into raw numbers. One might not be passionate about a toaster, but they can love or hate their car or their vacuum cleaner. Ask a Dyson owner of their opinion of Consumer Reports and the middling ratings of their wonderful machines.
In the case of appliances, it's not like one can walk into an appliance store with a loaf of Wonder bread and start testing the various toasters. Nor can one bring a load of laundry and try every washer/dryer combo. CU has come up with decent, real-world testing to rate the functionality of various appliances and whatnot and come up with rankings. Some are more subjective, like taste-testing canned hams. But anytime you subject something to testing, you basically reduce whatever that item is to it's functionality. When CU tests cars, they pit one model against another, do acceleration, braking and handling tests, judge the ease of use of controls and displays, measure cargo capacities and headroom in the back sets, etc. There is no category for how one car makes one feel when driving, though there are usually driving impressions noted. They might say an engine might be a bit noisy and use that as a strike against that car, but to some, that noise would be something desirable, like supercharger whine.
The more a particular item elicits a passion in the owner, the harder it is to objectlively reduce that passion into raw numbers. One might not be passionate about a toaster, but they can love or hate their car or their vacuum cleaner. Ask a Dyson owner of their opinion of Consumer Reports and the middling ratings of their wonderful machines.
Last edited by Greatbear; Mar 7, 2007 at 12:06 PM. Reason: typoe
Moderator can we move this thread to first gen?
I also think this thread belongs in the First Generation 02-06 section since these are the models CR is basing their assessments on.
(up from black dot.) This kind of yo-yo-ing nonsense is why, to me, CR is more of a gross shopping aisle curiousity than anything else. Like another poster, I used to sell consumer electronics and the ones CR recommended were the most problematic, while the ones they panned held up the best.
The whole thing is a huge scam based on exploiting people's consumer-product fears.

Go ahead and BASH my RAV4 or Toyota ALL you want but BASHING my DYSON crosses the line. Dysons Rock!
Stupid CR, now I know why MINI owners hate CR






I think the so-so ratings might be because the Dysons *are* expensive as hell for a vacuum cleaner, but I still think they should have been rated higher.
OK as a source on which toaster to buy. And maybe on which minivan to buy - maybe....
But worthless for information on enthusiast products of any kind, IMHO. Even for the products that capture reliability/satisfaction data from their reader base, I find that their reader base isn't a representative cross section of Americans or humans in general (you are likely to have some particular tendencies to subscribe to CR - not 100% of the time, but more often than not). And it certainly isn't representative of "enthusiasts" or "early adopters". I filled out my Strategic Vision survey for my new MCSC tonight. There are many questions on there where I said I was "Delighted" or "Very Satisfied" that would register a "Failure" from someone less "enthusiastic" about my car (ride comfort, NVH, etc). Context matters A LOT in these areas. Reasonable convertible owners expect their car to (a) cost more to purchase (b) have more mechanical issues (c) be noisier (d) eventually cost $$$ to replace a top out of warranty if they keep it long enough... so when all these things come true, will I pan the car for low reliability? No. Would someone with different expectations? Probably.
Any magazine that pans Corvettes for going "too fast" or a Lotus because the rear end comes around when you let off the gas in a corner, does NOT share MY context, or understand my priorities... and doesn't get a vote in my buying behavior...
... and we have a LOT more fun...
But worthless for information on enthusiast products of any kind, IMHO. Even for the products that capture reliability/satisfaction data from their reader base, I find that their reader base isn't a representative cross section of Americans or humans in general (you are likely to have some particular tendencies to subscribe to CR - not 100% of the time, but more often than not). And it certainly isn't representative of "enthusiasts" or "early adopters". I filled out my Strategic Vision survey for my new MCSC tonight. There are many questions on there where I said I was "Delighted" or "Very Satisfied" that would register a "Failure" from someone less "enthusiastic" about my car (ride comfort, NVH, etc). Context matters A LOT in these areas. Reasonable convertible owners expect their car to (a) cost more to purchase (b) have more mechanical issues (c) be noisier (d) eventually cost $$$ to replace a top out of warranty if they keep it long enough... so when all these things come true, will I pan the car for low reliability? No. Would someone with different expectations? Probably.
Any magazine that pans Corvettes for going "too fast" or a Lotus because the rear end comes around when you let off the gas in a corner, does NOT share MY context, or understand my priorities... and doesn't get a vote in my buying behavior...
... and we have a LOT more fun...

In all of the categories in which I have professional training and education (photography, Information Technology, Engineering and automobiles) I ALWAYS disagree with CR. They test for the average user.
Frankly, I even take their toaster testing with a grain of salt, but I do read the magazine just to have one more data source for my own analysis.
OK then...
how many more events, on average, that strand a motorist with a car that won't run, happen to Mini? Happen to Honda?
I think you'll find none of us know the answer to this. Also, many of the quality issues are very minor, and overall quality of most marks is significantly better than cars were 10 years ago.
All cars are pretty reliable now, it's relative measure that get blown up into discussions like this.
Matt
I think you'll find none of us know the answer to this. Also, many of the quality issues are very minor, and overall quality of most marks is significantly better than cars were 10 years ago.
All cars are pretty reliable now, it's relative measure that get blown up into discussions like this.
Matt
So, CeeTee1 and dneal...
do either of you know how often Minis strand their driver vs a Honda? I tried to find out, but can't find the statistics.....
Here's another one. Is a Mini from one or two years ago have more or less average number of defects than a Honda of 6 years ago (measured when the cars were new)? The reason I ask this is that 6 years ago, Hondas were still considered the paragon of reliability. Where would it fall on the quality scale today? I don't know the answers to these questions, but I bring them up to point out that what we're talking about is the perception of reliability, and if you'd bought a Mini or a Honda, you'd have a reliable car!
Matt
Here's another one. Is a Mini from one or two years ago have more or less average number of defects than a Honda of 6 years ago (measured when the cars were new)? The reason I ask this is that 6 years ago, Hondas were still considered the paragon of reliability. Where would it fall on the quality scale today? I don't know the answers to these questions, but I bring them up to point out that what we're talking about is the perception of reliability, and if you'd bought a Mini or a Honda, you'd have a reliable car!
Matt


I've reads the whole CR car issue. First, for those of you who can't wait to pounce on the "inferiority" of the R56, none of the data in the article is based on the R56. Aside from that, the issue shows that MINI has extremely high customer loyalty, with both maximum satisfaction and resale ratings (full red). Quality has been steadily improving for the MINI. The average and range of complaints for MINI is better than BMW and many other cars. It is also almost certainly true that MINI drivers are more picky about their cars than those who drive ordinary cars. Time after time I have witnessed examples of people just accepting rattles, vibrations, leaks, oil consumption, rust, rough idle, etc. in cars simply because they don't expect anything better. After reading the CR report, I am confident in my choice to be a MINI driver.
That would not be me
But.. the R56 is, so far, exhibiting the typical quality control trends of 1st year BMW products
I agree on that the quality of the MINI as a whole has been improving dramatically as each year has gone by
We have been driving MINIs as daily drivers since 2002 and so far none of them have let us down
Let's see, CR and the mega underpowered run away Audi 5000's. CR and best buy MB 180. CR and best buy Toro side walk trimmer. CR and any Maytag appliance. CR and GE Profile. Just this year CR and no safe baby seats for auto's. CR and latest stlling Honda recall. CR and Toyota motor law suit. CR and no American auto worth buying. Oh yea, CR the god of what to buy. Dream on..............




