Start a Conversation

Unsolved

This post is more than 5 years old

30135

March 8th, 2012 12:00

poor technical info on G12servers, need info

Hello,

This is mainly a feedbaack thread for Dell:

i've just downloaded the technical guidebooks for the R720 and T620 and i'm somewhat let down by the lack of in-depth technical info a book like this should show(they look more like overviews).

I open the R710, T710 or T610 technical guidebooks and they're PROPER guidebooks with all the info.

Some crucial info i find lacking in the new manuals that i require clarification or enhancement:

  1. No block diagram: in the T710 guidebook the block diagram has proven invaluable for sizing this server in several solutions as it allowed me to see where EVERY bit of i/o is routed as well as the BW for each route.
  2. No detailed photos with info on the insides: on the old manuals you had internal detailed photos with colored sections and info arrows pointing at WHAT is every notable device on the planar/case
  3. No detailed tech info for the chipset: there's virtually no info on the C600 chipset, on the old manuals you had dretails like pcie lane count, grouping, what connected to those/connectors, how they connect to the CPUs at what bandwidth, how many chipsets are there, etc, same as for the CPUs
    There's also no mention of the latency penalty on using LRDIMM and it's highly unclear when it's advantageous to use LRDIMM over RDIMM
  4. No details on pcie layout for devices: I had to download the R720 owners manual JUST to discovert the new PERC Hx10 is in a propietary daughtercard format! , and i don't even know if it's like that on the rest of the series(does the T620/720 also use this format or a regular card one?) because of 2 and 1 -no detailed photos or block diagram-, how is this OMMITED in a TECHNICAL guidebook?
    There's also no mention of the BW/lanes/where is the NDC/LOM is connected to, simply no info anywhere, the old guidebooks had detailed techspecs for the NIC controllers, all i could find in the new ones is a high-level feature table, not specifics like bus width and type.
    also, for the Intel X540 it's mentioned as 2x10Gbe + 2x1Gbe, HOW?, the Intel X540 only has 2x10Gbe with x8 pcie 2.0 interface, where do the extra 2x1Gb ports come from?, is it using a second NIC chip and a pcie switch?, or the NDC module is a full x16 lane connecotr?... lot of stuff in the dark...
    Weird not documented inconsistencies: each SNB xeon has 40 pcie3 lanes and they don't expose QPI to chipset, R720 has those 40 lanes routed to the pcie slots(3x8 1x16 for each socket), where do the NDC/NICs connect to then?, how many lanes?, at what version?, same for the PERC!.
    Where did Dell pull out those extra lanes from?
    It's even worse on the T620: 4x16, 2x8, 1x4 = 84 lanes, two sockets max=80 lanes, how did they pull out alll the extra pcie lanes needed?, and it says only socket 1 to 4 are available with one CPU... but WHAT SLOTS ARE THOSE?, there's no mention of which number slot corresponds to which lane width AT ALL!, you need to download the owners manual which is again -counterproductive and meaningless, old TECH manuals had it-

So for now there it is, i'd like for Dell to mend the new manuals and actually make them like the T710 guidebook that was one of the best i've seen -specially the block diagram that was missing from a lot of the RX10 series-.

For now at least i'd like a detailed answer/block diagram for the points i've put above, i simply can't configure a system for a customer not knowing crucial info like this and i don't like to receive nasty bottleneck surprises, there's a lot of very important info missing/obscured/vaguely commented that shouldn't be like that in any case.

Regards

5 Practitioner

 • 

274.2K Posts

March 9th, 2012 12:00

 

I looked over the document you are referring to:

 

http://i.dell.com/sites/content/shared-content/data-sheets/en/Documents/dell-poweredge-t620-technical-guide.pdf

 

http://www.dell.com/downloads/global/products/pedge/en/server-poweredge-t710-technical-guide-book.pdf

 

I can completely see where you are coming from, the T710 is very detailed with information, diagrams, pictures, etc. While the newer 12g documentation is lacking in the picture and diagram department. Right now I do not have any solid answer to this, but I could foresee some revisions to this documentation, to include some of this information. Also please keep in mind that some of the information that is not included in the new server technical guide has not been made public just yet. Once it has been made public, I would see no reason why the documents would not be revised to include such information. 

 

What I can do is try and answer some of your inquires, and provide some additional sources for information.

 

  1. Block diagram:

The new servers use the Intel C600 Patsburg chipset. I was able to find a block diagram images of the chipset.

http://semiaccurate.com/static/uploads/2011/01_january/patsburg.jpg

 

  1. I agree that the technical guide for the new server, compared to the T710, is lacking pictures and diagrams. To get the information you are looking for on what every little thing is on the server, we have to look at the owners manual.

http://support.dell.com/support/edocs/systems/pet620/en/t620omen.pdf

 

While not in color, it will take you through the front panel features, LCD panel, hard drive indicators, back panel, jumpers, system board diagram, etc. I know this is not ideal, but upon release of the 12g this is what we have to work with, with the anticipation of more detailed pictures being added as the 12g has more time to be documented.

 

  1. The C600 chipset is just as new as the Dell servers being released, so some information has not been made public from Intel. What has been made public from Intel can be found in these documents/links.

 

http://www.intel.com/content/dam/www/public/us/en/documents/datasheets/c600-series-chipset-datasheet.pdf

 

http://www.intel.com/content/www/us/en/chipsets/server-chipsets/server-chipset-c600.html

 

  1. The RAID controllers offered with the 12G servers are as followed.

PERC S110, PERC H310, PERC H710, PERC H710P, PERC H810.

The S110 is a S/W RAID controller and built into the system board. The H310 and H710 are adapters and have both a mini version, low profile,  and full height card, but will default to the mini version. The H810 does not have a mini version.

 

I am not seeing where it advertises the X540 as 2x10GBe + 2x1GBe, I may just be over looking this. The X540 is an additional NIC that would be added in. So I can see this being meant one of two ways. That you would have two 10GBe ports on the X540 and then two 1GBe ports on the integrated NIC.  Or it could just be advertising the different speeds that they could be used at, and not that is has 4 ports total.

 

I know this may not be all of the information you are looking for, and I am sure several of your questions will be answered as more of these diagrams and figures become public.

 

Here are some additional links and information that may be helpful.

 

PERC information.

http://www.dell.com/content/topics/topic.aspx/global/products/pvaul/topics/en/us/raid_controller?c=us&l=en&cs=555

 

http://www.dell.com/downloads/global/products/pvaul/en/dell-perc-h310-spec-sheet.pdf

 

http://www.dell.com/downloads/global/products/pvaul/en/dell-perc-h710p-spec-sheet.pdf

 

http://www.dell.com/downloads/global/products/pvaul/en/dell-perc-h710-spec-sheet.pdf

 

http://www.dell.com/downloads/global/products/pvaul/en/dell-perc-h810-spec-sheet.pdf

 

List of owners manuals.

http://support.dell.com/support/edocs/systems/

 

Dell 12th Generation PowerEdge Server Resources, this page is a good consolidation of general information on the new servers.

http://en.community.dell.com/techcenter/extras/w/wiki/3347.dell-12th-generation-poweredge-server-resources.aspx

 

Quick resource locator. This is designed as an app for phones, but can be used in a web browser also. It has a lot of good information, videos on where components are located, reference material, service tag lookup, and information on contacting Dell.

https://qrl.dell.com/qrlocator/productlist.aspx

 

Thanks.

1 Rookie

 • 

1.2K Posts

March 9th, 2012 14:00

I think the next couple of months will sort things out when all the 12G systems are released. All the white papers and tech docs will flow. I think Dell is juist being a bit cautious, they got stung before. A really cool ESXi box with opteron chips, they went to shows, did the demos and AMD mucked it up. The machine never saw daylight. By the way they use the patsburg-A chipset.

41 Posts

March 12th, 2012 07:00

Daniel,

thanks for the links, as you say, a lot of my burning question remain unanswered for now

specially the pcie lane layout for internal devices, because something doesn't adds even if using the C600 lanes (and first, they're pcie 2.0 lanes), the x4 pcie 3.0 links from cpu to C600 are used from the 40 lanes the cpu already has, so how does the full 40 lanes are exposed to pcie slots and borrowing x4 pcie 3.0?

unless this is being done over the DMI only (hiwch means a x4 pcie 2.0 bw shared over all onboard devices plus the x8 downlink... not good at all)

About the X540, in the R720 spec sheet for the NDCs you can see that, since there isn't an "onboard fixed nic" anymore, the X540 is not an additional one, is(one of) the onboard one to config

5 Practitioner

 • 

274.2K Posts

March 12th, 2012 09:00

On the R720 all the daughter cards are quad port.

5720

www.broadcom.com/.../2CS95720-PB00-R.pdf

57800

www.broadcom.com/.../2CS957800S-PB00-R.pdf

I350

ark.intel.com/.../Intel-Ethernet-Server-Adapter-I350-T4

The X520 is offered with the R720, but only as an add in adapter and dual port.

The configuration page can help show what is offered with the R720

configure.us.dell.com/.../config.aspx

I am sorry, I am not seeing where the X540 is listed, Could you point me at the link you are seeing it at?

On this sheet,

i.dell.com/.../Dell-PowerEdge-R720-Spec-Sheet.pdf

I see these for embedded,

Broadcom® Quad Port 1GbE BASE-T (no TOE or iSCSI offload)

Intel Quad Port 1GbE BASE-T (no TOE or iSCSI offload)

Intel Dual Port 10GbE BASE-T with 2 x 1GbE (FCoE capability enabled on the 10GbE ports)

Broadcom Dual Port 10GbE SFP+ with 2 x 1GbE (TOE and iSCSI offload available on 10GbE ports)

Thanks

41 Posts

March 12th, 2012 11:00

Daniel,

they removed the X540 from the configurator today, when i made the thread it was there to select.....

this is the X540: Intel Dual Port 10GbE BASE-T with 2 x 1GbE (FCoE capability enabled on the 10GbE ports).

source: R720 technical guide i.dell.com/.../dell-poweredge-r720-r720xd-technical-guide.pdf

page 31, table 15 : Intel X540

X540: ark.intel.com/.../Intel-Ethernet-Converged-Network-Adapter-X540-T2

only 2 ports, what are the other 2 gigE ports derived from in the Dell X540 NDC then?

5 Practitioner

 • 

274.2K Posts

March 12th, 2012 11:00

Thank you for pointing that out, I see what you are referencing now. To be honest I am not sure what table 15 is referring to, because that adapter is obviously a dual port card.

I am sure that during the evolution of how the 12G systems can be configured, given time the documentation will be revised to be in line. As well as being revised once more information becomes public. I apologize about any confusion the documentation may have caused.

Thanks.

1 Message

March 29th, 2012 11:00

Here are links to information about the Dell products that use the Intel(R) Ethernet Controller X540.

http://www.dell.com/downloads/global/products/pedge/poweredge_select_network_adapter.pdf 

http://intelethernet-dell.com/

The Intel Ethernet X540 DP 10Gb BT + I350 1Gb  BT DP Network Daughter Card option is now available on the Dell PowerEdge R720.

Rack Select Network Adapters

This is a single type of Select Network Adapter that supports four rack NDCs as follows:

Intel Ethernet Controller based NDCs

  •  Intel Ethernet X540 Dual Port 10Gb BT + I350 DP 1Gb BT NDC: A quad-port rack NDC with 2 ports x 1GbE(1000BASE-T) + 2 ports x10GbE (10GBASE-T) based on the Intel Ethernet Controller I350 and X540
  • Intel Ethernet I350 Quad Port 1GbE NDC: A quad-port rack NDC with 4 ports x 1GbE (1000BASE-T) based on the Intel Ethernet Controller I350

Dell-Driver
Intel_LAN_13.0.0_W2K8_64_A00.exe (32MB)                Recommended 3/9/2012          13.0.0, A00

Applies to:Dell Device 

Intel PCI-E 10Gig and 1Gig Family of Server Adapter Drivers

6 Posts

July 20th, 2012 13:00

Another issue that I am trying to resolve. The new Intel NIC's

Intel® Ethernet Server Adapter I350-T4

When I download the drivers which include a setup64.exe when you extract files comes with no supporting documentation on how to run silent install and other options during CLI installation.

Can anyone help? This all usually is on the page for the driver download under installation instructions or a .txt file bundled with software

Thanks

1 Rookie

 • 

1.2K Posts

July 21st, 2012 01:00

No Events found!

Top