VMware Community Homelabs
-
@stacksofplates said in VMware Community Homelabs:
@Pete-S said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@FATeknollogee said in VMware Community Homelabs:
Why don't we see this from the other Type-1 groups?
One thing the VMware "community" is very good at is grass roots movement.
From @lamw on Twitter:
https://www.virtuallyghetto.com/2020/02/vmware-community-homelabs-project.htmlBecause there is thing thing called the cloud, which is way cheaper and way more beneficial and efficient than spending thousands on hardware upfront.
Whatever it is, excluding some very specific scenarios, I'd rather learn and build it in Azure or AWS... You know, Two birds one stone.
The cloud is flexible but not cheap. It's only cheaper if your needs are very small or very dynamic. If you need performance or storage, cloud instances will get proportionally even more expensive.
And they know it of course. That's why they expand their services to make it harder to move the workload to another cloud provider or your own datacenter.
It 100% depends on the type of work. If you're taking in 5 billion requests per day, there's no way it's going to be cheaper on site than in public cloud.
Even with CFD type work where you'd normally have a cluster. You have to weigh the capex of the servers and the ongoing cost of the maintenance and utilities vs just spinning up 10-20 nodes when you need it. However if you get into long running solves like 6 months or so, then it might be cheaper on site. It really depends on the work load.
I think you're wrong. 5 billion hits per day is Google type traffic (a couple of years ago). And Google don't use the public cloud, they use their own servers. As do Facebook, Amazon, Ebay, Microsoft etc. People like Backblaze don't use the cloud.
The one company I know that I would expect to run their own servers but don't, are Netflix. They are on AWS. LinkedIn are also moving away from their own servers but that's not surprising since Microsoft owns them. I'm not sure they are actually running on Azure. It could be that they are just using Microsoft servers instead of their own.
Finance can calculate what's best but just because you're owning your server park doesn't mean you have to pay for it up front. It doesn't mean you don't have geo-redundancy or that it's all in one place. It doesn't mean you have to employ people that swaps hardware 24/7. And it doesn't mean you can't use cloud servers when you need.
-
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
-
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
I'm not sure you can say that Microsoft is on the public cloud when it's their servers and they own the hardware.
If the public cloud was cheaper than running their own hardware, Microsoft should move O365 and all their services to AWS. They would make a lot of money and not having to buy their own servers would be a great benefit.
-
@Pete-S said in VMware Community Homelabs:
I'm not sure you can say that Microsoft is on the public cloud
Yes, I can say that:
https://uk.pcmag.com/windows-10/118132/microsofts-cloud-how-the-company-eats-its-own-dog-food -
@Pete-S said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
I'm not sure you can say that Microsoft is on the public cloud when it's their servers and they own the hardware.
If the public cloud was cheaper than running their own hardware, Microsoft should move O365 and all their services to AWS. They would make a lot of money and not having to buy their own servers would be a great benefit.
Google/AWS/Azure are all public clouds, and I assume they all run their own stuff on their own systems - it would be crazy for them not to, and definitely bad for PR - look, our own shit isn't even good enough for us to run on.
-
@stacksofplates said in VMware Community Homelabs:
It 100% depends on the type of work. If you're taking in 5 billion requests per day, there's no way it's going to be cheaper on site than in public cloud.
Actually, the size of the load doesn't matter much. If it is 5billion every day, cloud will be the worst option. If it is 5 bil one day and 1 bil the next then back up and all over, that alone is when public cloud competes. No workload becomes public cloud viable based on size, ever. Only on elasticity. Elasticity is the sole benefit to cloud architecture. It's a huge one, but the only one.
-
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
Right, but to them it is a private cloud, not public.
-
@Dashrender said in VMware Community Homelabs:
@Pete-S said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
I'm not sure you can say that Microsoft is on the public cloud when it's their servers and they own the hardware.
If the public cloud was cheaper than running their own hardware, Microsoft should move O365 and all their services to AWS. They would make a lot of money and not having to buy their own servers would be a great benefit.
Google/AWS/Azure are all public clouds, and I assume they all run their own stuff on their own systems - it would be crazy for them not to, and definitely bad for PR - look, our own shit isn't even good enough for us to run on.
They are all public if you aren't those companies. They are all private if you are.
If I make my own OpenStack deployment for me, that's a private cloud. If i let you access it, it is still my private cloud, but you are using my public cloud.
All of those vendors do eat their own dog food, but they all get better dog food with more options and lower cost than their customers get. So their use of their own clouds is nothing like our use of it.
-
@scottalanmiller said in VMware Community Homelabs:
@Dashrender said in VMware Community Homelabs:
@Pete-S said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
I'm not sure you can say that Microsoft is on the public cloud when it's their servers and they own the hardware.
If the public cloud was cheaper than running their own hardware, Microsoft should move O365 and all their services to AWS. They would make a lot of money and not having to buy their own servers would be a great benefit.
Google/AWS/Azure are all public clouds, and I assume they all run their own stuff on their own systems - it would be crazy for them not to, and definitely bad for PR - look, our own shit isn't even good enough for us to run on.
They are all public if you aren't those companies. They are all private if you are.
If I make my own OpenStack deployment for me, that's a private cloud. If i let you access it, it is still my private cloud, but you are using my public cloud.
All of those vendors do eat their own dog food, but they all get better dog food with more options and lower cost than their customers get. So their use of their own clouds is nothing like our use of it.
I don't understand how that makes their use of it different other than the spend part - is your claim that that spend is so significant that it actually is what makes it different?
-
@Dashrender said in VMware Community Homelabs:
I don't understand how that makes their use of it different other than the spend part - is your claim that that spend is so significant that it actually is what makes it different?
Absolutely. They easily spend half, or even nothing at all. They have unlimited essentially free access to all unused capacity needed for their public cloud. And the can buy hardware specific to their needs. And they can have different APIs, tools, etc.
Pretty much it changes every aspect of everything. The real question is... in what way would it be the same as us using it as public end users?
-
@Dashrender imagine it another way.... public hardware.
You have a customer and they are thinking of buying a server for their office. They spend $10K on it.
Then you use the spare capacity on what they bought for free, because there is excess capacity.
For you, the decision to used 100% free, unused capacity is a no brainer (as long as they let you, obvs.) For them, the decision to purchase a $10K server is a huge deal.
Now imagine Amazon. They made billions selling their cloud services. Their cloud is a profit center, not a cost center. That they get to use it to run their own business is essentially all found money!
To their customers, it is 100% always a cost center.
-
Another thing to think about between private and public clouds.... public clouds offer fully elastic capacity. You can pay for zero, or a tonne at any moment. Private clouds have flexible capacity between workloads, but a set total capacity. You can never pay zero, you have to own the infrastructure.
To Amazon, MS, and Google, their total hardware capacity is not elastic. If they want to grow past maximum capacity, they have to invest. If they don't need that capacity any longer, they can't shrink it. They can't "stop paying". They can power down, but that's nothing compared to no having to rent the equipment any longer.
To their customers, they can simply release unneeded resources and reduce consumption, even to zero.
To customers, the capacity is elastic. To the owners, it is a zero sum game.
-
@scottalanmiller said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
Right, but to them it is a private cloud, not public.
Yes, a private space of their public cloud platform.
-
@Obsolesce said in VMware Community Homelabs:
@scottalanmiller said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@Pete-S I know that Microsoft eats it's own dog food. Can't speak for the others.
Right, but to them it is a private cloud, not public.
Yes, a private space of their public cloud platform.
right. it's their own dog food, but doesn't act like a public cloud.
-
@Pete-S said in VMware Community Homelabs:
@stacksofplates said in VMware Community Homelabs:
@Pete-S said in VMware Community Homelabs:
@Obsolesce said in VMware Community Homelabs:
@FATeknollogee said in VMware Community Homelabs:
Why don't we see this from the other Type-1 groups?
One thing the VMware "community" is very good at is grass roots movement.
From @lamw on Twitter:
https://www.virtuallyghetto.com/2020/02/vmware-community-homelabs-project.htmlBecause there is thing thing called the cloud, which is way cheaper and way more beneficial and efficient than spending thousands on hardware upfront.
Whatever it is, excluding some very specific scenarios, I'd rather learn and build it in Azure or AWS... You know, Two birds one stone.
The cloud is flexible but not cheap. It's only cheaper if your needs are very small or very dynamic. If you need performance or storage, cloud instances will get proportionally even more expensive.
And they know it of course. That's why they expand their services to make it harder to move the workload to another cloud provider or your own datacenter.
It 100% depends on the type of work. If you're taking in 5 billion requests per day, there's no way it's going to be cheaper on site than in public cloud.
Even with CFD type work where you'd normally have a cluster. You have to weigh the capex of the servers and the ongoing cost of the maintenance and utilities vs just spinning up 10-20 nodes when you need it. However if you get into long running solves like 6 months or so, then it might be cheaper on site. It really depends on the work load.
I think you're wrong. 5 billion hits per day is Google type traffic (a couple of years ago). And Google don't use the public cloud, they use their own servers. As do Facebook, Amazon, Ebay, Microsoft etc. People like Backblaze don't use the cloud.
The one company I know that I would expect to run their own servers but don't, are Netflix. They are on AWS. LinkedIn are also moving away from their own servers but that's not surprising since Microsoft owns them. I'm not sure they are actually running on Azure. It could be that they are just using Microsoft servers instead of their own.
Finance can calculate what's best but just because you're owning your server park doesn't mean you have to pay for it up front. It doesn't mean you don't have geo-redundancy or that it's all in one place. It doesn't mean you have to employ people that swaps hardware 24/7. And it doesn't mean you can't use cloud servers when you need.
5 billion hits per day is Google type traffic
No it's not. The specific company I'm referencing is a small company with around 35 employees. There's no way to cost effectively do that with on prem servers unless you have thousands of employees. That's the only reason places like Ebay, Facebook, etc are doing that. And Facebook's scale is just astronomical. They design and make their own racks, you can't even compare them to a normal company.
Sure Backblaze may not use them but that's a completely different use case as I said. However if you're running large data lakes and using ML you're not running your own infrastructure.
-
@stacksofplates said in VMware Community Homelabs:
However if you're running large data lakes and using ML you're not running your own infrastructure.
Actually we are testing moving ML to our own infrastructure because it'll be cheaper.
-
@scottalanmiller said in VMware Community Homelabs:
@stacksofplates said in VMware Community Homelabs:
It 100% depends on the type of work. If you're taking in 5 billion requests per day, there's no way it's going to be cheaper on site than in public cloud.
Actually, the size of the load doesn't matter much. If it is 5billion every day, cloud will be the worst option. If it is 5 bil one day and 1 bil the next then back up and all over, that alone is when public cloud competes. No workload becomes public cloud viable based on size, ever. Only on elasticity. Elasticity is the sole benefit to cloud architecture. It's a huge one, but the only one.
Yeah that's just not true. A) You're assuming that compute is the biggest factor here, B) It seems as though you're assuming they are making home grown things like just setting up NGINX proxies to everything.
Specifically the company I was talking about said their biggest cost was data going back out. Which they could easily mitigate with reducing HTTP headers, reducing TLS handshakes, and ended up using DigiCert because that cert was much smaller than the previous one they had which in turn limited outgoing data transfer.
There's a ton that goes into this and you can't just say it's cheaper to buy your own server vs rent a compute space. Things like K8s, "serverless" (whether you like that term or not), hosted ML, etc have completely changed the landscape.
-
@scottalanmiller said in VMware Community Homelabs:
@stacksofplates said in VMware Community Homelabs:
However if you're running large data lakes and using ML you're not running your own infrastructure.
Actually we are testing moving ML to our own infrastructure because it'll be cheaper.
So clearly I meant machine learning because I was referencing a data lake. Mangolassi doesn't talk to any data lakes as far as I know.
-
I find it funny for years @scottalanmiller has said that companies should be using cloud because of the multitude of benefits like security, cost, reliability, etc and has recently seemed to be backpedaling.
-
@stacksofplates said in VMware Community Homelabs:
@scottalanmiller said in VMware Community Homelabs:
@stacksofplates said in VMware Community Homelabs:
However if you're running large data lakes and using ML you're not running your own infrastructure.
Actually we are testing moving ML to our own infrastructure because it'll be cheaper.
So clearly I meant machine learning because I was referencing a data lake. Mangolassi doesn't talk to any data lakes as far as I know.
Oh sorry, really thought you were using ML as an example case.
