OSDev.org

The Place to Start for Operating System Developers
It is currently Thu Apr 18, 2024 4:43 pm

All times are UTC - 6 hours




Post new topic Reply to topic  [ 54 posts ]  Go to page Previous  1, 2, 3, 4
Author Message
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 3:38 am 
Offline
Member
Member

Joined: Sun Jun 16, 2013 4:09 am
Posts: 333
ggodw000 wrote:
working on the upcoming Broadwell-EX it is a monster with nearly 200 cores.
Wow, that would be fun to play with..

Ali


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 5:11 am 
Offline
Member
Member
User avatar

Joined: Sat Jan 15, 2005 12:00 am
Posts: 8561
Location: At his keyboard!
Hi,

ggodw000 wrote:
working on the upcoming Broadwell-EX it is a monster with nearly 200 cores.


A single Broadwell-EX is (up to) 24 cores now, and there's rumours Intel will release a 28-core version.

Your "200 cores" is from computers with 8 sockets (and 8 Broadwell-EX chips) - e.g. 8 * 24 = 192 (or 8 * 28 = 224).

Based on previous pricing (Intel's 22-core Xeon E5-2699 v4 at around ~$4100 a chip) you can expect a price of around $35000 for a system by the time you add on a (very expensive) 8-socket motherboard, a few (very expensive) 1500W+ power supplies, some RAM, some hard drives, etc.

In comparison; Xeon Phi will be ~72-cores for around $5000. In other words, for the same $35000 you could get 7 Xeon Phi machines with a total of 500 cores (and as a bonus you get ~8 GiB of high bandwidth "MCDRAM on chip" and AVX-512). ;)


Cheers,

Brendan

_________________
For all things; perfection is, and will always remain, impossible to achieve in practice. However; by striving for perfection we create things that are as perfect as practically possible. Let the pursuit of perfection be our guide.


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 5:37 am 
Offline
Member
Member
User avatar

Joined: Sat Jan 15, 2005 12:00 am
Posts: 8561
Location: At his keyboard!
Hi,

tsdnz wrote:
Thanks for responding, you make excellent points. You know a lot more about the hardware than I do. What hardware would you suggest?


I wouldn't suggest... The problem is that I don't actually know what "cloud" is supposed to mean.

Do you need a huge amount of permanent storage without much processing (cloud storage)? Do you need a large number of small/weak virtual machines? Do you need "high FLOPS" number crunching? Do you need low latency/high bandwidth networking between individual computers? Do you need fast Internet connections from "cloud" to the remote customer? The answers to these questions all depend on what "cloud" means to you, and what your cloud is intended to be used for.

tsdnz wrote:
I would like:
  • 4-8 cores
  • Memory not an issue, minimum 8GB, quick-ish, ECC
  • 64 Bit, SSE2+, would like AVX, PCIe 2+ 8xSlot
  • 2.0 GHz +
  • And cost efficient


You'll find that there's a "sweet spot" where everything is cheaper because it's what most people end up buying. Your specs seem to be right in the middle of that sweet spot. :)

tsdnz wrote:
Brendan wrote:
To test what?

To test if the OS works efficiently on computers that cloud providers are likely to use you need computers that cloud providers are likely to use.
To test the code I need multiple servers running, a minimum of 5 just to get it started. Currently I have code running as separate "OS's" inside an OS....., this was fine but I am at the stage where this is impossible to do. (Things happened in life that reduced my money, time and assets. Not a divorce, very weird experience.... Now to rebuild)


So you're testing how hard it is to saturate a gigibit ethernet switch (and not testing anything to do with the OS)?


Cheers,

Brendan

_________________
For all things; perfection is, and will always remain, impossible to achieve in practice. However; by striving for perfection we create things that are as perfect as practically possible. Let the pursuit of perfection be our guide.


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 10:09 am 
Offline
Member
Member
User avatar

Joined: Fri Oct 27, 2006 9:42 am
Posts: 1925
Location: Athens, GA, USA
Brendan wrote:
I wouldn't suggest... The problem is that I don't actually know what "cloud" is supposed to mean.


No one does. It is a vague marketing term meaning roughly, 'something to do with something living on some massive server farm somewhere'. It has no technical meaning at all. I won't say the term has no meaning of any kind, quite, but it is mostly just a catchphrase for a large number of things that used to be considered unrelated, such as automated offsite backup; client-server programs (which is also what 'web services' really means, just with the specific organizing principle of using HTTP for transfer and either XML or JSON for serialization, and usually being limited to tickling a database somewhere); web front ends for things like mail servers; and whatever else the corpse-rat marketing teams think will sell better with a fresh coat of paint.

Well, unless it's a company like SalesFarce, in which case as far as I can tell it means 'holding your development tools and code for ransom on our servers and brainwashing you into thinking that it's a good idea to hand total control of your company's software system and customer data over to us'. But then, my hatred of that loathsome beast, their horrid products, and their evil consultants is well known, so you should probably consider that a biased opinion.

_________________
Rev. First Speaker Schol-R-LEA;2 LCF ELF JAM POEE KoR KCO PPWMTF
Ordo OS Project
Lisp programmers tend to seem very odd to outsiders, just like anyone else who has had a religious experience they can't quite explain to others.


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 4:09 pm 
Offline
Member
Member

Joined: Sun Jun 16, 2013 4:09 am
Posts: 333
Schol-R-LEA wrote:
No one does. It is a vague marketing term meaning roughly, 'something to do with something living on some massive server farm somewhere'. It has no technical meaning at all. I won't say the term has no meaning of any kind, quite, but it is mostly just a catchphrase for a large number of things that used to be considered unrelated, such as automated offsite backup; client-server programs (which is also what 'web services' really means, just with the specific organizing principle of using HTTP for transfer and either XML or JSON for serialization, and usually being limited to tickling a database somewhere); web front ends for things like mail servers; and whatever else the corpse-rat marketing teams think will sell better with a fresh coat of paint.

Well, unless it's a company like SalesFarce, in which case as far as I can tell it means 'holding your development tools and code for ransom on our servers and brainwashing you into thinking that it's a good idea to hand total control of your company's software system and customer data over to us'. But then, my hatred of that loathsome beast, their horrid products, and their evil consultants is well known, so you should probably consider that a biased opinion.
I agree. I am hoping to make things better and easier, although it depends on who uses and/or markets their solutions on this platform.


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 4:24 pm 
Offline
Member
Member

Joined: Sun Jun 16, 2013 4:09 am
Posts: 333
Brendan wrote:
So you're testing how hard it is to saturate a gigibit ethernet switch (and not testing anything to do with the OS)?
Hi Brendan. I am testing how user-space software scales, allocating resources (Cores, servers, etc..), the message speed between servers, etc..., and adjusting the kernel code as I go.

Ali


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 5:12 pm 
Offline
Member
Member

Joined: Wed Nov 18, 2015 3:04 pm
Posts: 396
Location: San Jose San Francisco Bay Area
Brendan wrote:
Hi,

ggodw000 wrote:
working on the upcoming Broadwell-EX it is a monster with nearly 200 cores.


A single Broadwell-EX is (up to) 24 cores now, and there's rumours Intel will release a 28-core version.

Your "200 cores" is from computers with 8 sockets (and 8 Broadwell-EX chips) - e.g. 8 * 24 = 192 (or 8 * 28 = 224).

Based on previous pricing (Intel's 22-core Xeon E5-2699 v4 at around ~$4100 a chip) you can expect a price of around $35000 for a system by the time you add on a (very expensive) 8-socket motherboard, a few (very expensive) 1500W+ power supplies, some RAM, some hard drives, etc.

In comparison; Xeon Phi will be ~72-cores for around $5000. In other words, for the same $35000 you could get 7 Xeon Phi machines with a total of 500 cores (and as a bonus you get ~8 GiB of high bandwidth "MCDRAM on chip" and AVX-512). ;)


Cheers,

Brendan

Close, 200 is from 4 socket with 24 with hyperthreading enabled. 4 * 2 * 24.
It does support 8 sockets but through 3rd party implementations

_________________
key takeaway after spending yrs on sw industry: big issue small because everyone jumps on it and fixes it. small issue is big since everyone ignores and it causes catastrophy later. #devilisinthedetails


Last edited by ggodw000 on Tue May 10, 2016 3:18 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Sun May 08, 2016 11:53 pm 
Offline
Member
Member
User avatar

Joined: Sat Jan 15, 2005 12:00 am
Posts: 8561
Location: At his keyboard!
Hi,

ggodw000 wrote:
Brendan wrote:
ggodw000 wrote:
working on the upcoming Broadwell-EX it is a monster with nearly 200 cores.


A single Broadwell-EX is (up to) 24 cores now, and there's rumours Intel will release a 28-core version.

Your "200 cores" is from computers with 8 sockets (and 8 Broadwell-EX chips) - e.g. 8 * 24 = 192 (or 8 * 28 = 224).

Close, 200 is from 4 socket with 24 with hyperthreading enabled. 4 * 2 * 24.


Logical CPUs are not equivalent to cores and should never be called "cores". With hyper-threading disabled, four 24-core chips is a total of 96-cores (and has 96 logical CPUs). With hyper-threading enabled four 24-core chips is still a total of 96-cores (and has 192 logical CPUs).

Note that if you do want to compare logical CPUs; then Xeon Phi will be the first 80x86 CPU that has 4 logical CPUs per core, so a 72-core Xeon Phi has a total of 288 logical CPUs. ;)


Cheers,

Brendan

_________________
For all things; perfection is, and will always remain, impossible to achieve in practice. However; by striving for perfection we create things that are as perfect as practically possible. Let the pursuit of perfection be our guide.


Top
 Profile  
 
 Post subject: Re: Cloud Operating System - Are you interested in helping?
PostPosted: Tue May 10, 2016 3:17 pm 
Offline
Member
Member

Joined: Wed Nov 18, 2015 3:04 pm
Posts: 396
Location: San Jose San Francisco Bay Area
Brendan wrote:

Logical CPUs are not equivalent to cores and should never be called "cores". With hyper-threading disabled, four 24-core chips is a total of 96-cores (and has 96 logical CPUs). With hyper-threading enabled four 24-core chips is still a total of 96-cores (and has 192 logical CPUs).

Note that if you do want to compare logical CPUs; then Xeon Phi will be the first 80x86 CPU that has 4 logical CPUs per core, so a 72-core Xeon Phi has a total of 288 logical CPUs. ;)


Cheers,

Brendan

yeah i needed to brush up in those terms. I just liked to see under linux "cat /proc/cpuinfo | grep v4 | wc -l" shows 192 "entities". :lol:

p.s. too bad the forum does not allow more than 3 nested quotes :)

_________________
key takeaway after spending yrs on sw industry: big issue small because everyone jumps on it and fixes it. small issue is big since everyone ignores and it causes catastrophy later. #devilisinthedetails


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 54 posts ]  Go to page Previous  1, 2, 3, 4

All times are UTC - 6 hours


Who is online

Users browsing this forum: No registered users and 43 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group