@scale It appears we may not be in as good as shape as we thought. The drives going into the SAN are failing. Trying to move everything off now.
C
Posts made by CitrixNewbJD
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:
That's more business consulting, but something I always say to people looking to start a business.... if you are the owner, what are you bringing to the table that keeps people from just running the business without you? Is it fame, marketing, sales, investment dollars, a truly brilliant idea, property, experience, hard work, special knowledge, etc. If you don't have something that makes you critical, your team will be better off being your competitor than your staff.
A work visa. He's British/Canadian.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@NerdyDad Close. Friend of the family. He's also a really good guy, and probably a genius. He's on my side. Not necessarily a correlation to his genius, just sayin'.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@scottalanmiller He's been talking to his most trusted employee, a developer. Apparently he doesn't even understand that that Xen and the SAN are two completely different things...
I do plan on updating my LinkedIn profile and resume over the next few days.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@travisdh1 @seal Full backup created with what? As I noted yesterday there is no backup solution in place as of yet, unless you're referring to something I'm not grokking.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
Some VM OSes aren't coming up. Getting this on most (all?) of the VMs that had their OS on the downed SAN.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@Dashrender @scottalanmiller Systems are up. New disk in, VD is degraded and being rebuilt.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
On the phone with Dell, and the logs indicate that the two drives went down within seconds of each other, which may indicate that one of the drives isn't truly dead. They're going to try to revive it. Fingers crossed.
-
RE: If you are new drop in say hello and introduce yourself please!posted in Water Closet
@scottalanmiller @ghani Thanks for making me no longer the rookie!
-
RE: If you are new drop in say hello and introduce yourself please!posted in Water Closet
@scottalanmiller Howabout TravelingJay? I assume usernames are not case-sensitive for login?
-
RE: If you are new drop in say hello and introduce yourself please!posted in Water Closet
By the by, if I'm gonna stick around here, is it possible to change my username?
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
And yes, a cobbled together DC is in the plans after I get off the horn with Dell.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
No, there was a second SAN of which I was unaware. I know how bad that sounds, but since I've started here, it's been crisis after crisis, and I've had a quote from Scale that would have made all of this obsolete, provided the owner approved it in a conversation next week. I'm finding new things every day. With this probably going away in a week, I didn't spend a lot of time on it. This entire environment has been triage since I walked in the door.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
First, thanks everyone for your help yesterday, here's a brief update, more to come after a couple of phone calls.
I've powered down the SAN and reseated the drives. No joy. About to call Dell and see what options I may have, if any. The good news is there's a second SAN, and some data for the VMs is on there, but few OSes. The good news, is that somehow, I really have no idea how, the Xen servers reattached to the local storage overnight, and to the one virtual disk (Spindle2) and one DC is available. I'll give more details later.I wouldn't blame you for thinking I'm an incompetent tool, but I appreciate your help, anyway.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
At this point, I'm even at a loss on trying to figure out where to begin to explain to him how this is possible, as he hasn't seem to accept the premise in the first place.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
And the owner of the company refuses to accept anything I'm telling him. "There's no way a RAID array can fail. If we need to replace a couple of disk drives then we do that."
So this is fun.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@NerdyDad On the plus side, this environment was so effed up, I'm not THAT terribly upset about starting from scratch. It'll be a beating to get a lot of that data back, however. Anyone know of any services able to accomplish such a thing?
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
Looks like I'm building a bunch of new servers.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
A lack of a backup and DR strategy was one of the things I was brought in to remediate. No. There are no backups.
-
RE: XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!posted in IT Discussion
@seal Just came across these two items on the SAN interface. Dental_Data, Spindlemedia, are critical and it looks like those VDs failed.
PROFILE FOR STORAGE ARRAY: MDS-Spindle01 (12/27/16 3:28:58 PM) STANDARD VIRTUAL DISKS------------------------------ SUMMARY Number of standard virtual disks: 3 See other Virtual Disks sub-tabs for premium feature information. NAME STATUS CAPACITY RAID LEVEL DISK GROUP DRIVE TYPE Dental_Data Failed 1.495 TB 5 0 SAS SpindleMedia Failed 2.862 TB 5 0 SAS Virtual Failed 1.367 TB 5 0 SAS DETAILS Virtual Disk name: Dental_Data Virtual Disk status: Failed Capacity: 1.495 TB Virtual Disk world-wide identifier: 60:02:4e:80:00:7b:78:6a:00:00:04:13:4a:96:70:f3 Subsystem ID (SSID): 1 Associated disk group: 0 RAID level: 5 Physical Disk type: Serial Attached SCSI (SAS) Enclosure loss protection: No Preferred owner: RAID Controller Module in slot 1 Current owner: RAID Controller Module in slot 1 Segment size: 128 KB Capacity reserved for future segment size changes: Yes Maximum future segment size: 2,048 KB Modification priority: High Read cache: Enabled Write cache: Enabled Write cache without batteries: Disabled Write cache with mirroring: Enabled Flush write cache after (in seconds): 10.00 Dynamic cache read prefetch: Enabled Enable background media scan: Enabled Media scan with consistency check: Enabled Pre-Read consistency check: Disabled Virtual Disk name: SpindleMedia Virtual Disk status: Failed Capacity: 2.862 TB Virtual Disk world-wide identifier: 60:02:4e:80:00:70:ed:06:00:00:07:f5:4d:ba:7b:fb Subsystem ID (SSID): 2 Associated disk group: 0 RAID level: 5 Physical Disk type: Serial Attached SCSI (SAS) Enclosure loss protection: No Preferred owner: RAID Controller Module in slot 0 Current owner: RAID Controller Module in slot 1 Segment size: 128 KB Capacity reserved for future segment size changes: Yes Maximum future segment size: 2,048 KB Modification priority: High Read cache: Enabled Write cache: Enabled Write cache without batteries: Disabled Write cache with mirroring: Enabled Flush write cache after (in seconds): 10.00 Dynamic cache read prefetch: Enabled Enable background media scan: Enabled Media scan with consistency check: Enabled Pre-Read consistency check: Disabled Virtual Disk name: Virtual Virtual Disk status: Failed Capacity: 1.367 TB Virtual Disk world-wide identifier: 60:02:4e:80:00:70:ed:06:00:00:04:31:4a:96:73:09 Subsystem ID (SSID): 0 Associated disk group: 0 RAID level: 5 Physical Disk type: Serial Attached SCSI (SAS) Enclosure loss protection: No Preferred owner: RAID Controller Module in slot 0 Current owner: RAID Controller Module in slot 1 Segment size: 128 KB Capacity reserved for future segment size changes: Yes Maximum future segment size: 2,048 KB Modification priority: High Read cache: Enabled Write cache: Enabled Write cache without batteries: Disabled Write cache with mirroring: Enabled Flush write cache after (in seconds): 10.00 Dynamic cache read prefetch: Enabled Enable background media scan: Enabled Media scan with consistency check: Enabled Pre-Read consistency check: Disabled