CloudatCost Issues

Dashrender

For example, the MangoLassi database, which you can imagine is relatively busy, produces only .03% IOWait state average. It almost never spikes above .08% in any ten minute period.

That's point ZERO three. So 8.41 is 280 times higher!!

Does this than say that the servers C@C are providing are over provisioned? I understand that they are growing capacity and are working to resolve this.

Dashrender

@scottalanmiller said:

@Danp said:

What is a "good" average? On my Dev1 box, I'm seeing 8.41%. On my Dev3 box, I'm seeing 4.45%.

Average "should" approach zero. Definitely way under 1%.

Assuming this is a VM, and it's working correctly, even if he Host machine is super busy, would you expect to see these numbers be outside their normal range if the host is saturated?

scottalanmiller

@Dashrender said:

Does this than say that the servers C@C are providing are over provisioned? I understand that they are growing capacity and are working to resolve this.

It states this right on their status page. They know that they overprovisioned IO and are adding capacity.

Dashrender

@scottalanmiller said:

@Dashrender said:

Does this than say that the servers C@C are providing are over provisioned? I understand that they are growing capacity and are working to resolve this.

It states this right on their status page. They know that they overprovisioned IO and are adding capacity.

lol I know that, I was mainly asking the second part of my question, in the assumption that our VM is doing what it should.. why does it show a higher than expected IO load?
Is it aware of the other loads around it on the host?

scottalanmiller

@Dashrender said:

lol I know that, I was mainly asking the second part of my question, in the assumption that our VM is doing what it should.. why does it show a higher than expected IO load?
Is it aware of the other loads around it on the host?

Oh, I see. It doesn't show IO load. It shows IOWait state - the amount of time in which the CPU is stuck just waiting for IO to respond. So we have no idea what the load is, we only know that it can't respond to us.

Dashrender

@scottalanmiller said:

@Dashrender said:

lol I know that, I was mainly asking the second part of my question, in the assumption that our VM is doing what it should.. why does it show a higher than expected IO load?
Is it aware of the other loads around it on the host?

Oh, I see. It doesn't show IO load. It shows IOWait state - the amount of time in which the CPU is stuck just waiting for IO to respond. So we have no idea what the load is, we only know that it can't respond to us.

Aww.. ok great, nice lightbulb moment for me.. Thanks!

scottalanmiller

If the storage was super slow, like it had a carrier pigeon interface, it would show up as having high IOWait but low load. But with SSDs, we assume they are over loaded.

This post is deleted!

What is a SAR report? How do I get one?

scottalanmiller

@Aaron-Studer said:

What is a SAR report? How do I get one?

In Linux the command to get it is simply sar.

Ta da!

scottalanmiller

If you are missing the sar utility, it means that you forgot to install the sysstat utilities.

Either...

yum -y install sysstat

Or...

apt-get install sysstat

If you are on Ubuntu 14.04.2 LTS they do this ridiculous thing that it doesn't turn on my default. Run sar and it will tell you what to change to enable it. It's just editing one file to change a false to a true.

@scottalanmiller I always run CentOS7, per your recommendation

scottalanmiller

@Aaron-Studer said:

@scottalanmiller I always run CentOS7, per your recommendation

Good man. Just the yum and then it takes care itself. Nothing more to do. Report is blank for the first ten minutes after installing. It gets more useful over time. After an hour or so you'll have really useful data.

So what would be a reasonable time frame to fix such a issue?

Dashrender

Great, I just reset my Dev3 box and tried to connect to the console and it told my my attempt was logged for attempted hacking.. nice!

scottalanmiller

@Dashrender said:

Great, I just reset my Dev3 box and tried to connect to the console and it told my my attempt was logged for attempted hacking.. nice!

What gave you that message? Do you have a screenshot?

Dashrender

@scottalanmiller said:

@Dashrender said:

Great, I just reset my Dev3 box and tried to connect to the console and it told my my attempt was logged for attempted hacking.. nice!

What gave you that message? Do you have a screenshot?

I didn't grab one.. but I tried again and I see that it's still rebuilding my re-image...

Rebuilding a VM now seems to take about 30 minutes.

scottalanmiller

Should take under five minutes. I've reported the rebuild fail issues and they are looking into it. Just rebuild again if it doesn't work promptly. Doesn't hurt anything.