Potential Office365 (Exchange Online) Throttling Issue
-
@bigbear said
And the EWS limits being increased has never made an Outlook import for a large mailbox go faster or finish for me. But will be interesting to see if it does for you. I just wouldnt bet my lunch on it.
So you are saying you saw the same thing as me .. they said the took off the throttling, but nothing actually changes...
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
Right, but according to that link, MS throttles 3rd party migrations to .1 to .3 GB per hour.
We always open a ticket to request a temp lift on EWSLimits. I believe this has already been lifted for you per your comment above, but per my comment I don't believe the support guys know what you are talking about. And the EWS limits being increased has never made an Outlook import for a large mailbox go faster or finish for me. But will be interesting to see if it does for you. I just wouldnt bet my lunch on it.
How long does that take to go into effect once you request it?
We always do it a week or so in advance and they give you 90 days. As we are discussing this I am curious as to whether you could run powershell command Get-ThrottlingPolicy to see if its working on EWS...
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@bigbear said
And the EWS limits being increased has never made an Outlook import for a large mailbox go faster or finish for me. But will be interesting to see if it does for you. I just wouldnt bet my lunch on it.
So you are saying you saw the same thing as me .. they said the took off the throttling, but nothing actually changes...
They dont remove throttling but they increase the limits per your specific, kindly worded request
You would want to ask for throttling limits to be increased for 60 or 90 days in a new ticket and we always include these details (which came from MigrationWiz I think)
I always ask for xx (number of users) to be set for concurrent migration as well in the ticket.
EwsCutoffBalance = Unlimited
EwsMaxSubscriptions = xx
EwsMaxBurst = Unlimited
EwsMaxConcurrency = xx
EwsRechargeRate = UnlimitedAnd it did not seem to help Outlook import on a specific 15GB mailbox I recall, I had a dozen larger ones that also needed to complete so I moved on to MigrationWiz on that particular project.
-
A side note, per MigrationWiz support docs, you can no longer use Get-ThrottlingPolicy powershell commands against EWS/365 I had never thought of trying it before now...
-
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
A side note, per MigrationWiz support docs, you can no longer use Get-ThrottlingPolicy powershell commands against EWS/365 I had never thought of trying it before now...
Yeah I noticed that when I first starting Googling for this issue.
I spoke to the tech again just now. He said that his original request was for 15 days. And then a second tech asked for 30 days. He said they are very finicky about this, and he thought maybe going to 2 days would work, so he is going to try that, and also speak to the next level guys.
He did say we can use the PST option, and it seems to always be reliable. But that if they can get this throttle turned off temporarily, that THAT would be the best method.
Updates to come...
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
A side note, per MigrationWiz support docs, you can no longer use Get-ThrottlingPolicy powershell commands against EWS/365 I had never thought of trying it before now...
Yeah I noticed that when I first starting Googling for this issue.
I spoke to the tech again just now. He said that his original request was for 15 days. And then a second tech asked for 30 days. He said they are very finicky about this, and he thought maybe going to 2 days would work, so he is going to try that, and also speak to the next level guys.
He did say we can use the PST option, and it seems to always be reliable. But that if they can get this throttle turned off temporarily, that THAT would be the best method.
Updates to come...
So basically, no one knows how to submit this request internally.
-
@scottalanmiller said in Potential Office365 (Exchange Online) Throttling Issue:
So basically, no one knows how to submit this request internally.
Uh, yeah, that would be a good way of saying that.
-
@scottalanmiller said
So basically, no one knows how to submit this request internally.
Considering the latest update is .. that after talking to the next level up, it turns out this CANNOT be done, except possibly for large migrations. (Which makes no sense, so is probably not true.)
I would actually update this to no one over there knows what they are doing, actually.
They recommended going with the PST upload, which I am testing now.
I uploaded a 647K KB PST file to the system. It said it would import it, though it only said it was 550MB. So I am wondering if it is some sort of compression thing, some sort of PST vs. message storage thing, or just a mess up on their end.
Once the file was uploaded, I hit IMPORT. That was at 3:02. It's now 3:38 and this is what I see. I wonder if this is going to be a typical Microsoft update. Stay at 0% for an hour then say it is done.
-
You uploaded a file that was .6 MB and now MS is telling you it's 550 MB? damn, that's some expansion.
-
@dashrender said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB and now MS is telling you it's 550 MB? damn, that's some expansion.
647K KB (647,000 KB) is .6 MB?
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB
How is it going, I didn't even know you had a thread on this and I told you the same thing about PST
-
@dbeato said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB
How is it going, I didn't even know you had a thread on this and I told you the same thing about PST
It ended up taking about 70 minutes, but it completed. Now I have to look at the file and compare folders and see if everything copied over, especially since the PST file sizes were reported as different.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@dbeato said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB
How is it going, I didn't even know you had a thread on this and I told you the same thing about PST
It ended up taking about 70 minutes, but it completed. Now I have to look at the file and compare folders and see if everything copied over, especially since the PST file sizes were reported as different.
Was that the test upload or the 20Gb file
-
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@dbeato said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB
How is it going, I didn't even know you had a thread on this and I told you the same thing about PST
It ended up taking about 70 minutes, but it completed. Now I have to look at the file and compare folders and see if everything copied over, especially since the PST file sizes were reported as different.
Was that the test upload or the 20Gb file
The test upload.
I am checking through it now ... it seems to have worked.
I got thrown off by the stupid filter setting Outlook has ... had to go through the folders and de-select that, but it seems to have gotten them all.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@bigbear said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@dbeato said in Potential Office365 (Exchange Online) Throttling Issue:
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
You uploaded a file that was .6 MB
How is it going, I didn't even know you had a thread on this and I told you the same thing about PST
It ended up taking about 70 minutes, but it completed. Now I have to look at the file and compare folders and see if everything copied over, especially since the PST file sizes were reported as different.
Was that the test upload or the 20Gb file
The test upload.
I am checking through it now ... it seems to have worked.
I got thrown off by the stupid filter setting Outlook has ... had to go through the folders and de-select that, but it seems to have gotten them all.
Or right click properties and check the file count and stuff?
-
@jaredbusch said
Or right click properties and check the file count and stuff?
Eh? You mean folder size in properties?
I wish Outlook and OWA had a way to easily display the number of messages in a folder. MDaemon has an option to show (X/Y) for each folder where x is unread and Y is total. It makes it so much easier to compare.
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
@jaredbusch said
Or right click properties and check the file count and stuff?
Eh? You mean folder size in properties?
I wish Outlook and OWA had a way to easily display the number of messages in a folder. MDaemon has an option to show (X/Y) for each folder where x is unread and Y is total. It makes it so much easier to compare.
Outlook has always had this with size, if not message count. but if they match you should be good I would assume.
Compare local and server. You can have the new mailbox online only so you don't have to cache..
You can look at the properties of each folder and see the total. but that is super manual.
-
@jaredbusch said in Potential Office365 (Exchange Online) Throttling Issue:
Outlook has always had this with size, if not message count. but if they match you should be good I would assume.
They never match exactly, though, which is the issue.
You can change Outlook to display the number of items, but that is also very manual as you have to do it for every folder.
I basically randomly write down folders, and check through them. I figure if 20 out of 40 are correct, they all should be.
I think Exchange must calculate storage differently than MDaemon and the PST. Not surprising. Maybe it compresses it by default.
I've never actually administered Exchange, so don't know.
-
Trying the PST import method. Honestly, it isn't much better.
Have a 3.28 GB PST upload to Office365 already. Started the import at 2:03. It is now 6 hours later and it is only 59% done. So this seems like it might even be SLOWER than the other way.
WTH, Microsoft. Why do you make it so hard to switch to your product?
-
@brrabill said in Potential Office365 (Exchange Online) Throttling Issue:
Trying the PST import method. Honestly, it isn't much better.
Have a 3.28 GB PST upload to Office365 already. Started the import at 2:03. It is now 6 hours later and it is only 59% done. So this seems like it might even be SLOWER than the other way.
WTH, Microsoft. Why do you make it so hard to switch to your product?
I am still amazed at how long it has taken you, I am not sure from what email system you are coming from but usually I do importa initially a month or 2 weeks before and then do deltas every week with the Builtin migration tool.