"There won't be a big WAN Show segment about this or anything. Most of what I have to say, I've already said, and I've done so privately.
To Steve, I expressed my disappointment that he didn't go through proper journalistic practices in creating this piece. He has my email and number (along with numerous other members of our team) and could have asked me for context that may have proven to be valuable (like the fact that we didn't 'sell' the monoblock, but rather auctioned it for charity due to a miscommunication... AND the fact that while we haven't sent payment yet, we have already agreed to compensate Billet Labs for the cost of their prototype). There are other issues, but I've told him that I won't be drawn into a public sniping match over this and that I'll be continuing to move forward in good faith as part of 'Team Media'. When/if he's ready to do so again I'll be ready.
To my team (and my CEO's team, but realistically I was at the helm for all of these errors, so I need to own it), I stressed the importance of diligence in our work because there are so many eyes on us. We are going through some growing pains - we've been very public about them in the interest of transparency - and it's clear we have some work to do on internal processes and communication. We have already been doing a lot of work internally to clean up our processes, but these things take time. Rome wasn't built in a day, but that's no excuse for sloppiness.
Now, for my community, all I can say is the same things I always say. We know that we're not perfect. We wear our imperfection on our sleeves in the interest of ensuring that we stay accountable to you. But it's sad and unfortunate when this transparency gets warped into a bad thing. The Labs team is hard at work hard creating processes and tools to generate data that will benefit all consumers - a work in progress that is very much not done and that we've communicated needs to be treated as such. Do we have notes under some videos? Yes. Is it because we are striving for transparency/improvement? Yeah... What we're doing hasn't been in many years, if ever.. and we would make a much larger correction if the circumstances merited it. Listing the wrong amount of cache on a table for a CPU review is sloppy, but given that our conclusions are drawn based on our testing, not the spec sheet, it doesn't materially change the recommendation. That doesn't mean these things don't matter. We've set KPIs for our writing/labs team around accuracy, and we are continually installing new checks and balances to ensure that things continue to get better. If you haven't seen the improvement, frankly I wonder if you're really looking for it... The thoroughness that we managed on our last handful of GPU videos is getting really incredible given the limited time we have for these embargoes. I'm REALLY excited about what the future will hold.
With all of that said, I still disagree that the Billet Labs video (not the situation with the return, which I've already addressed above) is an 'accuracy' issue. It's more like I just read the room wrong. We COULD have re-tested it with perfect accuracy, but to do so PROPERLY - accounting for which cases it could be installed in (none) and which radiators it would be plumbed with (again... mystery) would have been impossible... and also didn't affect the conclusion of the video... OR SO I THOUGHT...
I wanted to evaluate it as a product, and as a product, IF it could manage to compete with the temperatures of the highest end blocks on the planet, it still wouldn't make sense to buy... so from my point of view, re-testing it and finding out that yes, it did in fact run cooler made no difference to the conclusion, so it didn't really make a difference.
Adam and I were talking about this today. He advocated for re-testing it regardless of how non-viable it was as a product at the time and I think he expressed really well today why it mattered. It was like making a video about a supercar. It doesn't mater if no one watching will buy it. They just wanna see it rip. I missed that, but it wasn't because I didn't care about the consumer.. it was because I was so focused on how this product impacted a potential buyer. Either way, clearly my bad, but my intention was never to harm Billet Labs. I specifically called out their incredible machining skills because I wanted to see them create something with a viable market for it and was hoping others would appreciate the fineness of the craftsmanship even if the product was impractical. I still hope they move forward building something else because they obviously have talent and I've watched countless niche water cooling vendors come and go. It's an astonishingly unforgiving market.
Either way, I'm sorry I got the community's priorities mixed-up on this one, and that we didn't show the Billet in the best light. Our intention wasn't to hurt anyone. We wanted no one to buy it (because it's an egregious waste of money no matter what temps it runs at) and we wanted Billet to make something marketable (so they can, y'know, eat).
With all of this in mind, it saddens me how quickly the pitchforks were raised over this. It also comes across a touch hypocritical when some basic due diligence could have helped clarify much of it. I have a LONG history of meeting issues head on and I've never been afraid to answer questions, which lands me in hot water regularly, but helps keep me in tune with my peers and with the community. The only reason I can think of not to ask me is because my honest response might be inconvenient.
We can test that... with this post. Will the "It was a mistake (a bad one, but a mistake) and they're taking care of it" reality manage to have the same reach? Let's see if anyone actually wants to know what happened. I hope so, but it's been disheartening seeing how many people were willing to jump on us here. Believe it or not, I'm a real person and so is the rest of my team. We are trying our best, and if what we were doing was easy, everyone would do it. Today sucks.
For me, this is the main point, GN has prided itself in integrity and making sure meticulous detail is done on every benchmark, LTT doesn't do that and only worries about pumping out 7-10 videos a week to keep up with the YouTube algorithms (which may or may not be a real issue). I'm inclined to be behind GN on this one.
LTT is trying to be reliable, but they aren't giving themselves the time to do it. Mistakes are made and aren't corrected or aren't corrected in the best way.
I'm not buying that, there's probably a little bit of truth in there, but honestly it's pretty clear what's happening. The higher ups require a certain amount of videos a week to be profitable, if they don't meet that quota then they're not making money or they think they're not making money. They're also pretty clearly favoring their sponsors and reviewing their products positively without showing actual credible benchmarks. It's the sign of corporate greed creeping in once again and someone finally called out their bullshit. Linus isn't taking it very well, and I can imagine why when someone you thought to be a friend or colleague is now calling you out with credible evidence that you're just bullshitting around and half-assing the product you build from the ground up.
If they aren't giving themselves the time to do it then it means they aren't trying to be reliable. After all, these are self imposed deadlines they set themselves. Actions speak louder than words, and despite the PR attempts the presentation says quantity is more important than being correct
Which is completely fine for entertainment content like building a flying PC, but there's different expectations for more serious pieces they are trying to sell to consumers as being trustworthy. Unless they want the stigma of the Verge of PC building when it comes to LTT product reviews. Where people say I just watch it for the jokes and product shots, but ignore the recommendations.
"I expressed my disappointment that he didn’t go through proper journalistic practices in creating this piece. He has my email and number (along with numerous other members of our team) and could have asked me for context that may have proven to be valuable"
It's exactly the opposite, by not giving Linus a preview of the material, and allowing him input on it. Steve has secured the journalistic integrity of the content.
Linus had a chance to address the content publicly and is opting not to do it.
"Most of what I have to say, I’ve already said, and I’ve done so privately."
He clearly thinks we are not worth keeping informed so I'm going to be unsubscribing and no longer consuming any LTT content.
Overall this response sucks. No accountability, plenty of deflection and missing the point. Vague talk of being more accurate in the future, so I'm supposed to just wait and consume inaccurate content in the mean time? No thanks.
I think GN did a great job here and am disappointed in Linus' response, but it's worth noting that it would indeed be appropriate to reach out for comment while working on an investigative piece like this.
It's different from providing a copy of a review to a vendor before releasing. It's more about, "what's your answer to this?" as part of the due diligence. I'm surprised Steve never reached out and remain skeptical about the suggestion that he didn't try. That would be my only criticism of GN on this piece. Everything else seemed very well done.
I can see your point. But I'm the end Linus is still saying he's not going to answer to anyone publicly including his audience, he can do better. The rest of the statement is awful as well.
Dude secret shops companies and posts a video about it one week, a week or two later he gets equivalent to being secret shopped by a fellow youtuber and is up in arms about it. The narcissism is palpable.
I kind of expect that LMG will very slowly disintegrate (it might take years), as many of their staff are concerned with the tight schedules and are probably under a lot of stress. I wouldn't be surprised to see some of their current staff opening up their own smaller channels later, independent of LMG.
I'm not going to unsubscribe, I still enjoy much of LTT content, however as soon as I'm serious about buying some specific hw piece, I always watch GN and Hardware Unboxed videos first.
That's how I feel. I don't watch LTT for reviews I watch them for the videos where they do dumb shit with servers or water cooling or whatever and the WAN show is nice side monitor content on my Friday nights.
If I am genuinely interested in a product like a GPU I usually look at multiple sources for benchmarks. Trusting just one is creating a single point of failure.
It absolutely is not the correct response. LTT and GN are very public and the suggestion to take the conversation private is bad. There is no backroom conversation that can "fix" shitty data.
I agree with Linus taking accountability for publishing bad test results. That is a good thing. Talking shit about GN and refusing to walk back on that is bad. That is unprofessional.
I've never watched a video or paid attention to these guys but it certainly didn't sound like he was taking accountability for bad test results. He spent quite a while explaining why accuracy wasn't important.
What part about that was talking shit about GN? I haven't seen the video, but the vibe I'm getting is GN was talking shit about LTT, and LTT didn't want to start a shit flinging contest?
Edit: Watched the video. That was brutal. The GN response was disproportionate to the quips, but at the same time justified.
Also, after watching all that, I feel the need to say Linus is super arrogant on the wan show and I never watch it.
It would have been kind to linus to do it directly, but honesty to the audience is what matters the most. The criticism has to go both ways if you are going be honest and reliable journalists. Would Telling him in private really change things for something that is a core issue with the business? I don't think so. The audience will tell you if your work is good enough or you fall from your failure to comply.
like the fact that we didn’t ‘sell’ the monoblock, but rather auctioned it for charity due to a miscommunication… AND the fact that while we haven’t sent payment yet, we have already agreed to compensate Billet Labs for the cost of their prototype
That’s kinda not better or a defense. Or even a clarification.
The prototype is still gone, regardless of who received the money for it. That's still a massive liability for Billet Labs to have floating out in the wild.
Also, I don't know why he felt the need to put 'sell' in quotes, as if auctioning isn't a form of selling. Plus GN mentioned it was auctioned, many times.
It looks like they are paying it back which was my biggest concern, and billet is defining the price here. Although according to his earlier response, LMG has yet to repay it.
That fuck up is still massive, downplaying it as a "charity auction" is shitty and makes this 120~ person company look like amateur hour.
I was mislead and because how linus worded it, thought this was at least arranged prior to the whole situation and that this was not a quote or invoiced. According to billet lab this was not the case and they had yet to set a price as of that second videos recording.
The biggest fault that was committed is that Linus didn't just take the L and admit they fucked up and they would fix the problem instead of doubling down. Blaming GN for not telling him about it personally is not how journalism is supposed to work. Friend or not.
This also isn't the "gotcha" LMG tried to make it seem at the intro in their response. They basically said "GN didn't get our side of the story so they are making us bad, they didn't know we repaid Billet Labs!"
It's inexcusable how they tested, handled, and then auctioned the block, doesn't matter that they agreed something at the end, what GN said still stands.
LTT and Linus himself are just a bunch of clowns. And it irritates me that they call themselves tech experts or a tech channel. At the best they're tech entertainers.
The video that really made me do a double-take and start to notice how bad their content really is, was the one about their storage server screw up from a year and a bit ago.
It reeks of a bunch of amateurs messing around with tech they truly don't understand. Allan Jude talked on a fairly recent episode (can't remember which podcast, I think it was 2.5 Admins) about helping Wendell from Level1 with the recovery process on LTT's storage server. He was really trying hard (and in all fairness succeeded) in being professional in talking about it, but you can just hear in his voice that he felt like he was dealing with a group of rich teenagers out of their league.
I lost respect for Linus Sebastian a long time ago, but now I think he's a terrible and greedy person.
As someone who has worked with enterprise servers/networking for over 10 years now, I avoid any videos where they're talking about their servers or networking. I've watched a lot of them but the mistakes and odd choices make it unenjoyable for me personally. I have always chalked it up to them dumbing it down for their audience but maybe it's inexperience.
Either way, I enjoy a lot of their content but haven't used their reviews to pick out new products for a long time.
Frankly, this whole situation boils down to exactly what I expected. LTT has always produced content at an insane velocity, and issues like these are the inevitable results. Miscommunications, errors that need to be tidied up, and compromises such as that water block video not being redone with the proper setup. LTT doesn't have the ability to reverse course on an emergency like that, they're already at breakneck pace so that they can't make a change of that scope without missing deadlines. If it wasn't this, it would've been something else.
Is that evil? I don't know. It's the business strategy they've gone with, and much of why they're in the position they are. An LTT that put out half the videos they do may have never made it to this position. This is a good wake up call as to the costs of that kind of operation, and it's up to you how you choose to react to this.
Yeah, this certainly raises to mind the times I've heard them discuss on WAN Show how employees have inquired about reducing the release schedule, and how that's not considered a real option. That decision has costs...
I've never watched that dude, but I know who he is and what he does. At the end of the day, he's just another youtuber, just churning videos as fast as possible, using stupid thumbnails like everybody else. Just quantity over quality, because that's what produces revenue. I have more respect for the "jesus guy".
There forum is down from so many people posting. Crazy. The internet is so unstable right now, first with twitter, then reddit, and now a massive youtube company.
LTT has produced a variety of videos that either do not reliably review their products, give accurate information, and other issues. As well as a major fuckup with a watercooling company. Having watched the whole thing, GN has a point.