XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!
-
@scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
That said, I agree it's not the solution. If you really wanted to have a DC outside this cluster, fine, but you still virtualize that third server, then install a DC on that.
While I generally agree that "outside the cluster" is good in extreme cases where you have extreme levels of AD dependencies, that's not necessary. Same cluster with different storage is all that is needed. Same scenario on a Scale cluster, for example, would not have a problem even being on a single cluster. Having "inter-cluster" protection is good, but a whole level beyond what is needed here.
Right, just don't setup circular requirements and you should be fine - sure it means having an extra set of credentials, but compared to eveything else you need if you don't do that, probably not worth it.
-
@Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
That said, I agree it's not the solution. If you really wanted to have a DC outside this cluster, fine, but you still virtualize that third server, then install a DC on that.
While I generally agree that "outside the cluster" is good in extreme cases where you have extreme levels of AD dependencies, that's not necessary. Same cluster with different storage is all that is needed. Same scenario on a Scale cluster, for example, would not have a problem even being on a single cluster. Having "inter-cluster" protection is good, but a whole level beyond what is needed here.
Right, just don't setup circular requirements and you should be fine - sure it means having an extra set of credentials, but compared to eveything else you need if you don't do that, probably not worth it.
That would protect against the one issue of circular dependencies. Obviously don't do that. But there is also the "single point of failure" risk that the SAN creates. A single cluster doesn't necessarily carry that risk either. An HC cluster (like Scale, Starwinds, Nutanix, Simplivity) doesn't have the single SAN dependency problem either. Both are major risks here, and both are 100% outage issues here. We just appear to have hit both at once.
-
A lack of a backup and DR strategy was one of the things I was brought in to remediate. No. There are no backups.
-
Looks like I'm building a bunch of new servers.
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
A lack of a backup and DR strategy was one of the things I was brought in to remediate. No. There are no backups.
Oh no.
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
Looks like I'm building a bunch of new servers.
I'd say your almost starting from scratch.
-
@NerdyDad On the plus side, this environment was so effed up, I'm not THAT terribly upset about starting from scratch. It'll be a beating to get a lot of that data back, however. Anyone know of any services able to accomplish such a thing?
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@NerdyDad On the plus side, this environment was so effed up, I'm not THAT terribly upset about starting from scratch. It'll be a beating to get a lot of that data back, however. Anyone know of any services able to accomplish such a thing?
I ran into a similar issue with a failed drive almost 2 months ago. Almost lost the farm on it. I had a RAID6 on an EqualLogics. I called ACE Data Recovery here in Dallas. They told me to bring my last failed drive and a brand new drive of the same model and size to them. Overnight and $2,400 later, my SAN was limping along enough for me to get the data off of it and retire the SAN. I don't know where at in Dallas you are, but it might be worth checking out. They may be able to help.
Ace Data Recovery
17778 Preston Rd
Dallas, TX 75252
(972) 528-6580
http://www.datarecovery.net/They close at 7:00 tonight.
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
A lack of a backup and DR strategy was one of the things I was brought in to remediate. No. There are no backups.
Wow. Just.... wow.
-
What storage do you have for the servers? Your san is dead; your xs cant connect to local. Right now the company is nonexistant except for incorporation papers at the state of incorporation.
I would try to do something with that san, power it off, pull it out of the rack and reseat the cards and drives.
Turn it on and watch post and bootup, login to the web interface and see if you actually have hardware failure going on. At least try to get it working long enough to get that data. -
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@NerdyDad On the plus side, this environment was so effed up, I'm not THAT terribly upset about starting from scratch. It'll be a beating to get a lot of that data back, however. Anyone know of any services able to accomplish such a thing?
That's good. And none of it is your fault. Sounds like every inch of the old design was set up for disaster.
-
@NerdyDad said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
Looks like I'm building a bunch of new servers.
I'd say your almost starting from scratch.
Completely from scratch, really.
-
Wow - ug... data recovery sounds like your only option. I've heard of ACE data recovery, never used them though.
good luck!
-
And the owner of the company refuses to accept anything I'm telling him. "There's no way a RAID array can fail. If we need to replace a couple of disk drives then we do that."
So this is fun.
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
And the owner of the company refuses to accept anything I'm telling him. "There's no way a RAID array can fail. If we need to replace a couple of disk drives then we do that."
So this is fun.
WHAT? You called him in Europe and he told you that? Ug.. time to look for another job?
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
... "There's no way a RAID array can fail. ..."
So, this is going to get interesting. Might be time to brush up that resume...just in case.
-
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
And the owner of the company refuses to accept anything I'm telling him. "There's no way a RAID array can fail. If we need to replace a couple of disk drives then we do that."
So this is fun.
Every piece of that setup was designed to fail. He's clearly incompetent and you now see why such a bad setup exists. I'd look for other work. You just got some serious insight into the cluelessness of this company.
-
@NerdyDad said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
@CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
... "There's no way a RAID array can fail. ..."
So, this is going to get interesting. Might be time to brush up that resume...just in case.
Honestly, after a statement like that I'd start job hunting proactively. No IT future in a company with someone so idiotic at the top.
-
If this was a court case, I'd testify that this was designed to lose data. If that owner tries to make an insurance claim, it should be fraud. This was a system that spent extra money and put in extra effort to ensure that data loss was not just possible but extremely likely.
If the owner takes a role in IT decisions then the bad decision making falls to him. Being completely honest, I'd fire an intern for this many mistakes at this level. No future in working for someone that we'd not hire as a high school intern.
-
At this point, I'm even at a loss on trying to figure out where to begin to explain to him how this is possible, as he hasn't seem to accept the premise in the first place.
