Burned by Eschewing Best Practices
-
Scott Alan Miller May 26, 2017 at 9:51 AM
Niagara Technology Group (NTG) is an IT service provider.
ICH wrote: Quite simply you are right and the VAR is wrong. Do NOT trust him, no matter how many years experience he is quoting you. He is simply WAY behind the curve here."Behind the curve" for perspective here... what he is telling you is based off of a 1998 Microsoft recommendation BUT MS was VERY clear when they made the recommendation to explain why they made it so that you would know when it did not apply any longer. And it stopped applying a LONG time ago. That he is repeating it suggests that he memorized a rule of thumb without understanding it which is a standard quick and dirty trick to sound like an IT pro when, in fact, he's just repeating something he heard. It means he doesn't understand what RAID is or how it works. RAID 5 was industry deprecated in 2009, and Dell is so strongly against RAID 5 that they pulled it from some of their interfaces to protect users from themselves and so that no one could claim that Dell supported it by including it as an option! That's how bad your VAR is.
-
toby wells May 26, 2017 at 10:08 AM
CrimsonKidA wrote: Toby, while you are right, this is the same kind of lip-service (no offense) he's getting from his VAR. He needs facts here to back up his argument. + expandWell I also posted a link to a thread where Dell (The OP server vendor) state not to use RAID 5 for critical data but I think we are all essentially on the same page here. Physical workloads on R5 = bad. Virtual on R10 = good
-
CrimsonKidA May 26, 2017 at 10:33 AM
Scott Alan Miller wrote: There is another thread on this right now. Just be aware that hosted email doesn't imply O365. O365 is a premium luxury service, as is Exchange in general, and people often use it as the high cost example to debunk. But there are services at a fraction of that cost like Rackspace and Zoho and Appadillo, that run enterprise email so cheaply that it is those that make for the "you can't afford to run it in house" arguments. O365 is only if you are comparing Exchange to Exchange, not email to email. + expandGood points here, thanks. SAM is right, it's not an apple-to-apples comparison. I think Hosted Exchange vs on-premise essentially is, but obviously there are still differences. I'd be interested to see the other thread if you have the link, SAM?
-
essjae May 26, 2017 at 3:38 PM
toby wells wrote: Its like asking an architect why arches are good for bridges They just are RAID 5 was deprecated by most vendors many years ago, I think Dell were last to issue something but that was in 2012! https://community.spiceworks.com/topic/251735-new-raid-level-recommendations-from-dell 5 Years since its probably one of the most discussed topics on Spiceworks The maths and practical experience is just overwhelming + expandHere's links to the actual Dell docs:
http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/19861480/download.aspx
-
cavemanager May 27, 2017 at 12:53 AM
Evan7191 wrote: I agree with the others that you should use one big RAID10. I won't say that you should fire your VAR, but you should not let a sales person design a system for you. Sales exist to sell products in order to make money. Their goal is for you to purchase their goods and/or services. Their goal is not to give you the best solution for your needs. You must look out for your environment and tell them what you need. If they won't sell what you need, then you can find a different VAR who will.I really should have clarified that my Dell VAR is also someone sort of like a sysadmin. He has a company that deploys and manages IT solutions for businesses around the area and he is also a certified Dell re-seller. That being said, he still seems a bit lacking in the up-to-date IT knowledge and best practices arena..
-
cavemanager May 27, 2017 at 12:56 AM
Scott Alan Miller wrote: That's a LOT of servers. How big are you? We'd normally expect that from 1,000+ users. + expandNot that big but we are a financial institution and there were several servers running various applications over the last 7 years. We also have a virtual environment so I am including like 3 hosts and a SAN. I am working to eliminate old servers by virtualizing them. So, why the hell do I want to buy a physical server for Exchange? I got talked into it by my VAR.. but now I've changed my mind and am going to make sure we just virtualize the thing.
-
OP
cavemanager May 27, 2017 at 1:04 AMtoby wells wrote: Its like asking an architect why arches are good for bridges They just are RAID 5 was deprecated by most vendors many years ago, I think Dell were last to issue something but that was in 2012! https://community.spiceworks.com/topic/251735-new-raid-level-recommendations-from-dell 5 Years since its probably one of the most discussed topics on Spiceworks The maths and practical experience is just overwhelming + expandThat article looks like it's pertaining to Dell's Equallogic arrays, which would be those big SAN racks. My whole question in the OP was about RAID volumes on Dell PowerEdge servers. I should have clarified... unless, somehow, they are both ultimately the same thing?
Also, funny enough, we actually did just get a new Dell SAN (which Dell support has referred to as an "Equallogic device", yet according to the support tech who set it up, it is actually in JBOD with parity. -
cavemanager May 27, 2017 at 1:39 AM
toby wells wrote: Its like asking an architect why arches are good for bridges They just are RAID 5 was deprecated by most vendors many years ago, I think Dell were last to issue something but that was in 2012! https://community.spiceworks.com/topic/251735-new-raid-level-recommendations-from-dell 5 Years since its probably one of the most discussed topics on Spiceworks The maths and practical experience is just overwhelming + expandThat article looks like it's pertaining to Dell's Equallogic arrays, which would be those big SAN racks. My whole question in the OP was about RAID volumes on Dell PowerEdge servers. I should have clarified... unless, somehow, they are both ultimately the same thing?
Also, funny enough, we actually did just get a new Dell SAN (which Dell support has referred to as an "Equallogic device", yet according to the support tech who set it up, it is actually in JBOD with parity.
-
Scott Alan Miller May 27, 2017 at 9:13 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: I really should have clarified that my Dell VAR is also someone sort of like a sysadmin. He has a company that deploys and manages IT solutions for businesses around the area and he is also a certified Dell re-seller. That being said, he still seems a bit lacking in the up-to-date IT knowledge and best practices arena.. + expandClearly this is incorrect and makes things SO much worse. But to be clear, a salesman is a salesman. That really idiotic companies hire a salesman to be their IT doesn't change that he's a salesman.
Also, he is NOT out of date, he's trying to not do good IT work. Don't equate being unqualified with being out of date. His information is based off of a MISTAKEN interpretation of info from the 1990s, but had he learned it properly twenty years ago, he'd not be doing what he is doing today. He'd have been incompetent twenty years ago too, just would have been harder to hide it.
-
Scott Alan Miller May 27, 2017 at 9:14 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: That article looks like it's pertaining to Dell's Equallogic arrays, which would be those big SAN racks. My whole question in the OP was about RAID volumes on Dell PowerEdge servers. I should have clarified... unless, somehow, they are both ultimately the same thing? Also, funny enough, we actually did just get a new Dell SAN (which Dell support has referred to as an "Equallogic device", yet according to the support tech who set it up, it is actually in JBOD with parity. + expandYou need to rethink your "techs". JBOD means no parity is possible. Once it has parity, it can't be JBOD. The purpose of the world JBOD is to clarify that it can't have parity or mirroring. Also, why do you have a SAN at all? Same crooked salesman/VAR looking to make a quick buck?
http://www.smbitjournal.com/2011/07/never-get-advice-from-a-reseller-or-vendor/
http://www.smbitjournal.com/2016/06/buyers-and-sellers-agents-in-it/You need to rethink how your business interacts with sales organizations.
-
Scott Alan Miller
Pure Capsaicin
Scott Alan Miller May 27, 2017 at 9:18 AMNiagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: Not that big but we are a financial institution and there were several servers running various applications over the last 7 years. We also have a virtual environment so I am including like 3 hosts and a SAN. I am working to eliminate old servers by virtualizing them. So, why the hell do I want to buy a physical server for Exchange? I got talked into it by my VAR.. but now I've changed my mind and am going to make sure we just virtualize the thing. + expandThat VAR is an outright crook. There is no condition where he should have thought it was even possible to get away with claiming a physical Exchange server was acceptable. He's WELL into "you could sue him" territory here for claiming to have IT knowledge. And three hosts with a SAN is not an option, that's an inverted pyramid of doom and there is no condition under which a SAN can be paired with just three hosts, or even four. At five, there are rare conditions where reliability is a low priority where it can happen, but it is an edge case. But at three, anyone who even whispered the word SAN should have been marched out of the building and banned from ever talking to you again.
I'm dead serious. Even if you don't purse legal action, distance yourself from that VAR immediately. He's not just a bad friend, he is outright your enemy and taking outrageous advantage of your company.
-
Scott Alan Miller May 27, 2017 at 9:20 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: That article looks like it's pertaining to Dell's Equallogic arrays, which would be those big SAN racks. My whole question in the OP was about RAID volumes on Dell PowerEdge servers. I should have clarified... unless, somehow, they are both ultimately the same thing? Also, funny enough, we actually did just get a new Dell SAN (which Dell support has referred to as an "Equallogic device", yet according to the support tech who set it up, it is actually in JBOD with parity. + expandThat your VAR did it in your server instead of a SAN is neither here nor there. What he did was unthinkable and unprofessional. Even as a VAR, intentionally sabotaging clients to make a quick buck isn't legal. Should you know better than to have a salesman doing your IT for you, yes. But that doesn't excuse him going out of his way to leverage that to do damage, either.
-
cavemanager May 27, 2017 at 9:35 AM
Scott Alan Miller wrote: You need to rethink your "techs". JBOD means no parity is possible. Once it has parity, it can't be JBOD. The purpose of the world JBOD is to clarify that it can't have parity or mirroring. Also, why do you have a SAN at all? Same crooked salesman/VAR looking to make a quick buck? http://www.smbitjournal.com/2011/07/never-get-advice-from-a-reseller-or-vendor/ http://www.smbitjournal.com/2016/06/buyers-and-sellers-agents-in-it/ You need to rethink how your business interacts with sales organizations. + expandugh.. this whole post is getting out of hand and I'm probably just going to delete it. Before I do, we have a SAN because we've had a virtual environment since I started. We are growing that and ditching physical servers. Our tech that deployed the SAN was issue directly from Dell and when I asked him how the drives were configured, he said JBOD with two disks for parity. I had also understood that JBOD did not involve parity at all, so I was confused. Anyway, I just NOW looked at the configuration and it's actually a RAID10.. which is HILARIOUS to me because when we were setting it up, I was actually asking about the RAID settings because I specifically wanted to set it up in a RAID 10.... omfg.. the people I work with...
-
Scott Alan Miller May 27, 2017 at 9:40 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: ugh.. this whole post is getting out of hand and I'm probably just going to delete it. Before I do, we have a SAN because we've had a virtual environment since I started. We are growing that and ditching physical servers. Our tech that deployed the SAN was issue directly from Dell and when I asked him how the drives were configured.... + expandDell is FAMOUS for doing this. This is EXACTLY what should have been avoided. I never claimed that YOU did it, but there was never a case where this was okay to do. Dell has taken a lot of flak for their salespeople taken advantage of customers to make quick money on SAN sales in this way and is literally the most famous vendor for doing this. If you hope to get "free advice" from their sales team - they sell the same bad solution every time because they know that if you are asking a salesman for IT advice, that you are just looking to get sold something you don't need. It's so bad that we tell everyone that is going to talk to them what they are going to try to screw them with before they talk - and they do it EVERY time.
That it is Dell proves the point, it is not a defense as you are imagining. I've been that tech working for Dell. They are just random local people that they call last minute. They aren't Dell staff, they are not Dell trained and they just install what they are told to install. But any SAN coming in an inverted pyramid like this is just a salesman who was your predecessor coming from a mile away and figured it'd be too long before anyone caught on that he'd have his commission and be gone. And it worked.
-
Scott Alan Miller May 27, 2017 at 9:42 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: ugh.. this whole post is getting out of hand and I'm probably just going to delete it.Why? Why would all this advice SO much more important than what you had intended to talk about, be "out of hand" and why would you delete it (that's VERY bad forum etiquette.) We are trying to help you and you've exposed that you really, really need help not just in a small technical matter but on a larger scale. You desperately need business and IT oversight because right now sales people are screwing your company left and right. No one is stepping up and providing the IT oversight of the sales people. There is no IT, only sales people and buyers.
It's not that you need to rethink IT, it's rethinking the business engagement of salespeople across the board.
-
Scott Alan Miller May 27, 2017 at 9:44 AM
Niagara Technology Group (NTG) is an IT service provider.
cavemanager wrote: omfg.. the people I work with...That's why you might want to take this thread to the CEO. I'm serious, engage someone at the top. Express REAL concerns. This isn't just a question of technical stuff or making money, this is a question of ethics. As someone that audits companies for this kind of stuff, these are the signs that you have someone in a senior position that is not doing their job and hiding behind sales people. It's a common tactic to make big salaries while not doing the job that they are hired to do. I'm talking about your CIO most likely. Someone is selling out the company and likely making a pretty penny doing it.
That doesn't imply that there are vendor kickbacks, but once someone is stealing their salary from the company, what's a kickback or two?
-
Scott Alan Miller
This is an industry standard problem in the SMB space and you'll see it all over this community, too. People who hide behind IT titles but don't actually do any IT work or act as the IT person / role but instead of "IT buyers" and just "buy IT" from vendors. But since they don't act in an IT role, they don't play the part of protecting their companies from predatory sales people and since "sales is free" and "expertise is expensive" to avoid budget concerns they go to sales people and get the "IT for free" and instead just get sold products that they claim that they need.
It's a really effective way to get paid as an IT pro, but do, quite literally, nothing. No need for any skills at all, no need to keep up, no need to even work. Sales people are always happy to do this "work" for free - but of course the only thing that they do is sell you things that you don't need because that's their actual job that they are paid to do. One hour of IT consulting would have protected your institution from all of these issues, that's all it takes. But lacking ALL IT oversight, someone just let a sales organization into the company to "rape and pillage" at will.
Think of IT like the castle guards. They are paid to protect the business. But in a case like this, it looks like the senior guard either decided doing his job was too much effort or got slipped some gold in a bag and literally opened the gates to let the known attackers in to have at the undefended castle. But the guards keep reporting to the king that all is well and the people stealing are not to be worried about.
Does that make sense? At some point, someone is making money and the IT protection isn't happening. These are literally the textbook examples of how this happens. If you look at SW, there are literally thousands (I really mean that) threads about how this exact scenario should never happen, and how VARs and vendors will take advantage of it, and how Dell does this specifically, etc. It could not fit the predicted scenario more. And the articles I linked, they are years old but fit your scenario exactly. There is a reason for that. This is the pattern that we look for for these kinds of problems.
-
I felt that we should grab all of that as the OP was threatening to delete it as it exposed his boss the CTO and his relationships with resellers; but it was such a good example of how one senior manager trying to get away without doing his job can sabotage a company.
-
We all totally understand that YOU are not the one at fault here. You have a boss that doesn't know what he is doing (or worse, that's the really scary part) and you are new to the company and IT in general. But you are in a position now to do something about it. Is it worth making waves? It is worth exposing what we assume must be a form of corruption (pretending to be a CTO level and not even being a viable entry level tech and getting paid to screw the company is a form of corruption here and appears to be the best case scenario?) Only you can know that. But I've worked in financials where, if I was in your position, I would be required by my social contract with the company to take this information to the CEO. That does NOT mean that you make claims of corruption, theft, ineptitude or impropriety. That's not how it works. YOU take this thread, print it out and say "look Mr. CEO, I had this conversation and a casual oversight of our organization left a large number of IT pros looking at us as having some very visible problems ranging from technical incompetence to outright fraud and inappropriate / unethical reliance on sales people at vendors to do the work that we are tasked with doing internally to protect the company. I'm new to IT and I'm new here, but they thought that I should pass this on to you, unfiltered, so that you could decide if they were right, wrong or if you even care either way. My job is only to bring it to your attention, not to pass judgment on it. So here it is, do with it what you will."That's all that YOU need to do. Then, whatever. but use this as a learning experience for yourself. You need to KNOW that your CTO isn't qualified to work for me as an intern and if I was a CEO (and I am) he's be fired and I'd seriously consider legal charges based off of the things you've said here. From a purely business, non-technical standpoint, he should be fired for the relationships he's build on impropriety. On a technical level, he should be fired for having allowed such obvious abuses of the company that anyone even moderately technical should have seen. No matter what his technical OR business levels, he should have protected the firm from what has happened thus far. And this is likely just the tip of the iceberg. Every little thing you've mentioned here is atrocious. Imagine what less obvious things are going on if this is what they were willing to do with full visibility!
-
Has a physical backup server, that after being updated with new firmware and drivers was bricked. OP was able to get the system restored and functional after several hours working with Dell.
