Potential Office365 (Exchange Online) Throttling Issue
-
I have been converting my users over from an in-house MDaemon server to Office365.
It's been going well (with the exception of a small hiccup I quickly figured out) until today.
I saved the largest users for the end. Today's user had 70K messages and about a 21GB mailbox.
I used IMAP to download the messages to a new profile with no issue. I then added the Office365 account, and copied everything over. Again, no issues. Until it tries syncing/upload the new content.
The upload speed has been absolutely crawling all day. I reached out to Microsoft support about it, and they are pretty certain we are being throttled, and are working on it. Though I have not heard back from them in a while.
It seems to be uploading at about a 1.5Mbps rate, which seems too coincidental, so I agree with the throttling diagnosis. (The machine this is on gets averages of 75/75 in other speed tests.)
I'll let you know what the resolution is.
-
If I had posted this, someone who works at MS would pop in here and claim there would have to be a conspiracy for this to be happening and that you are too small of a customer for them to have orchestrated such a complex attack against you
-
I think my original tech went home.
Maybe that is part of the conspiracy.
-
I called and opened a new ticket. This guy is claiming "it just takes a while" ... I get that, but it shouldn't be uploading at 1994 speeds.
Grrrrrrrr....
-
You're uploading via the activesync protocol - I'm sure MS has a limit on it.
Using the PST uploader option I would expect to be full open.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
I think my original tech went home.
Maybe that is part of the conspiracy.
They have lives, too.
-
@scottalanmiller said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
I think my original tech went home.
Maybe that is part of the conspiracy.
They have lives, too.
They are supposed to pass the case on. That is what I have experienced in the past. It actually works very well.
-
@dashrender said in Potential Office365 (Exchange Online) Throttling Issue:
You're uploading via the activesync protocol - I'm sure MS has a limit on it.
Using the PST uploader option I would expect to be full open.
Have you seen the directions for that? The way I am doing it for smaller cases is so much easier.
Plus can you imagine freezing hundreds of users, exporting PST files, and then uploading them, and the converting them?
Seems like a MAJOR CF to me.
-
So the new tech said this is definitely a throttling issue, and he also issued a command to allow the mail to be uploaded unthrottled. We will see if HIS command works.
-
Shockingly nothing has changed. He did say it might take two hours to propagate. I guess changes made over the Internet from India to MS are sloooooooow.
-
You are going to want to do a network upload of your PST files using AzCopy to free Azure storage space MS offers for migrations. I have done hundreds of larger PST files like the one you are stuck on and I can tell your current import won't complete ever.
Just google "365 pst network upload".
MS365 has become more and more useless with the shift to CSP and "partner first" initiatives. Do everything you can to get escalated back to the U.S. if you ever need real help.
-
-
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
You are going to want to do a network upload of your PST files using AzCopy to free Azure storage space MS offers for migrations. I have done hundreds of larger PST files like the one you are stuck on and I can tell your current import won't complete ever.
Just google "365 pst network upload".
MS365 has become more and more useless with the shift to CSP and "partner first" initiatives. Do everything you can to get escalated back to the U.S. if you ever need real help.
I gave him the link to that 4 hours ago.
he didn't want to do that. -
@dashrender said in Potential Office365 (Exchange Online) Throttling Issue:
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
You are going to want to do a network upload of your PST files using AzCopy to free Azure storage space MS offers for migrations. I have done hundreds of larger PST files like the one you are stuck on and I can tell your current import won't complete ever.
Just google "365 pst network upload".
MS365 has become more and more useless with the shift to CSP and "partner first" initiatives. Do everything you can to get escalated back to the U.S. if you ever need real help.
I gave him the link to that 4 hours ago.
he didn't want to do that.Did not see anything in this thread about it. The method he is using has never worked for larger files for me.
-
@bigbear yes @Dashrender did give me the link offline a while back.
However, I figured that would be just as much of a CF as the method I am using.
Part of the issue is that we do not have PST files. The MDaemon Outlook Connector software we are using has its own format.
So, I am assuming this is what I would want to do...
- Disable user access to their mailbox
- Set up a new profile with IMAP and download all the messages to this.
- Export this new profile's e-mail to a PST file
- Run the PST import method as you (and @Dashrender) suggested
How long would you say a PST import of, say 20GB would take using this method?
-
@bigbear said in
I can tell your current import won't complete ever.
Oh boy I hope that is not true!
That would leave this particular user in disarray.
They keep telling me they can turn this throttling off temporarily, but then the next sentence is always "but this is normal behavior" so who knows what to believe.
The second guy has also left for the day, and won't be back for 2 days. So in the morning I am going to call and get this hopefully escalated to US tech support.
This is the first really large mailbox I have worked with. I had no idea there were such limits. To be honest, it is something I never would have thought of.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
They keep telling me they can turn this throttling off temporarily, but then the next sentence is always "but this is normal behavior" so who knows what to believe.
Those aren't conflicting statements in any way.
-
@scottalanmiller said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
They keep telling me they can turn this throttling off temporarily, but then the next sentence is always "but this is normal behavior" so who knows what to believe.
Those aren't conflicting statements in any way.
Well, that is true.
I guess what I meant was ... I get the feeling that is a preface to "hey what we did didn't work, but too bad"
-
I might also try IMAP migration, which a couple people have suggested. IMAP migration has a throttle as well, but the expected throughput is 14-20GB an hour, which would be perfect for me. (The current scenario is .5 GB per hour.)
Honestly, the way I was doing it was working so well, I didn't see a need to do anything else.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
I used IMAP to download the messages to a new profile with no issue.
What file format did you download to? You can still create a non-exchange profile and import to a PST file, then upload that to Azure using AzCopy.
Also for $10 or $12 you can use IMAP to 365 with BitTitan Migrationwiz which you may find much simpler, since its only this single mailbox.
I will admit MigrationWiz is much simpler and it does multiple passes. Just gets expensive when you have hundreds of mailboxes.
