14 Posts
0
6918
Pushing Dell T7500 beyond 96GB RAM
Sorry for the wrong board but there no longer is a board for Precision line
Anyway maybe someone here can help
So I have a Dell T7500 with 96GB ram - 12x 8GB PC3 10600R (1333MHz).
I'd like to upgrade it to 192, but it gets a little confusing.
Pushing it requires 12x 16GB PC3 10600R (1333MHz) - they are quad rank.
OK, but there is a note in the manual:
"If more than one Quad rank DIMM is installed within a channel (DIMM1 & DIMM4, DIMM2 & DIMM5, DIMM3 & DIMM6) then the maximum DDR3 speed is reduced to 800 MHz. Spreading Quad Rank memory modules accross multiple channels is recommended."
What speed are they referring to?
Are we dropping from 1333MHz down to 800MHz? If so, that upgrade , we get twice the ram but half the speed
Maybe it's the single rank speed being capped at 800MHz. If so, the 1333MHz memory runs at 667MHz anyway so no biggie. Wait, does the quad rank memory run at 333MHz???
They suggest a solution, spreading the Quad modules to different channels, and there is a configuration in the table with 128GB - 4 of the 6 channels get a single 16GB module, everything else is populated with 8GB - yay
Except after that the table jumps straight to 192GB configuration. What about 144GB???
6x16GB +6x8GB - the quads are spread to all the channels, we get 144GB at full speed.
But why did they not mention this? Is 144GB not supported for some reason???
Also what is the whole deal with 192GB needing Red Hat?
Does windows not support it??
Techgee
590 Posts
0
June 10th, 2020 15:00
Thanks for posting this.
From the article I posted prior, I think the slowdown is related to quad rank DIMMs. So, maybe the 16GB sticks are dual rank?
Would be interested in what specific DIMM model number you are using successfully. Rank? ECC? Registered?, etc.
Also, what specific 32GB DIMM model didn't work?
Thanks again.
kacorefx
14 Posts
0
June 11th, 2020 12:00
Techgee
590 Posts
1
June 16th, 2020 17:00
Usually, to get higher amounts of RAM at some point you have to switch to LRDIMMs (Load Reduced DIMMs).
The T7500 uses the Intel 5520 chipset. Although the memory controller is in the CPU, here's two SuperMicro 5520 chipset motherboard specs, which lists differing memory details, including support for DIMMs up to 16GB for one, 32GB for the other:
Board #1 - up to 16GB DIMMs
Board #2 - up to 32GB DIMMs
What's interesting, though, is the memory capacity progression for the board supporting 32GB DIMMs:
up to 48GB: UDIMM
up to 192GB: RDIMM
up to 384GB: LRDIMM
So, I'm thinking if the T7500 supports 32GB DIMMs it might require 32GB LRDIMMs.
kacorefx
14 Posts
0
June 18th, 2020 06:00
The ones I tried were LRDIMM
Techgee
590 Posts
0
June 18th, 2020 08:00
The 32GB DIMM you linked to, Micron MT72KSZS4G72PZ-1G4E2, is DDR3L-1333 (1.35v with support for 1.5v) Quad Rank RDIMM (Registered aka Buffered) with ECC.
It's not a LRDIMM.
From Micron's site - spec (expand Data Sheets).
kacorefx
14 Posts
0
June 18th, 2020 19:00
Oh yeah, you're right. I mixed it up because they were lower voltage
may29
2 Posts
0
December 20th, 2020 04:00
My T7500 (Bios A18, Xeon E5649@2.53GHz) works fine
even with mixed 6x32GB population:
3x Samsung M393B4G70BM0-YH9 (=quad rank, 32GB 4Rx4 PC3L-10600R) +
2x Samsung M393B4G70DM0-YH9 (same spec as above) +
1x Hynix HMT84GR7AMR4A-PB (=quad rank 4Rx4 PC3L-12800R)
I only have single socket, so this gives my 192 GB Ram.
With dmidecode it shows "Size: 0kB" but works fine:
e.g.
693 Handle 0x1101, DMI type 17, 27 bytes
694 Memory Device
695 Array Handle: 0x1000
696 Error Information Handle: No Error
697 Total Width: 72 bits
698 Data Width: 64 bits
699 Size: 0 kB
700 Form Factor: DIMM
701 Set: None
702 Locator: DIMM 2
703 Bank Locator: Not Specified
704 Type: DDR3
705 Type Detail: Registered (Buffered)
706 Speed: 1333 MT/s
707 Manufacturer: 80CE80B380CE
708 Serial Number: 36.....
709 Asset Tag: 021.....
710 Part Number: M393B4G70BM0-YH9
Intel mlc shows this memory speed:
1070 Intel(R) Memory Latency Checker - v3.9
1071 Measuring idle latencies (in ns)...
1072 Numa node
1073 Numa node 0
1074 0 65.5
1075
1076 Measuring Peak Injection Memory Bandwidths for the system
1077 Bandwidths are in MB/sec (1 MB/sec = 1,000,000 Bytes/sec)
1078 Using all the threads from each core if Hyper-threading is enabled
1079 Using traffic with the following read-write ratios
1080 ALL Reads : 16829.1
1081 3:1 Reads-Writes : 17445.6
1082 2:1 Reads-Writes : 17602.4
1083 1:1 Reads-Writes : 17796.2
1084 Stream-triad like: 16678.3
So this shows quad rank 32 GB DIMMs are accepted and working.
may29
2 Posts
0
December 20th, 2020 05:00
In my previous post the "mlc" report was for 3x32 GB population:
1070 Intel(R) Memory Latency Checker - v3.9
1071 Measuring idle latencies (in ns)...
1072 Numa node
1073 Numa node 0
1074 0 65.5
1075
1076 Measuring Peak Injection Memory Bandwidths for the system
1077 Bandwidths are in MB/sec (1 MB/sec = 1,000,000 Bytes/sec)
1078 Using all the threads from each core if Hyper-threading is enabled
1079 Using traffic with the following read-write ratios
1080 ALL Reads : 16829.1
1081 3:1 Reads-Writes : 17445.6
1082 2:1 Reads-Writes : 17602.4
1083 1:1 Reads-Writes : 17796.2
1084 Stream-triad like: 16678.3
For the 6x32 GB population there is speed downgrade:
1070 Intel(R) Memory Latency Checker - v3.9
1071 Measuring idle latencies (in ns)...
1072 Numa node
1073 Numa node 0
1074 0 70.6
1075
1076 Measuring Peak Injection Memory Bandwidths for the system
1077 Bandwidths are in MB/sec (1 MB/sec = 1,000,000 Bytes/sec)
1078 Using all the threads from each core if Hyper-threading is enabled
1079 Using traffic with the following read-write ratios
1080 ALL Reads : 13642.0
1081 3:1 Reads-Writes : 13198.7
1082 2:1 Reads-Writes : 13161.5
1083 1:1 Reads-Writes : 13629.9
1084 Stream-triad like: 12337.7
kaczorefx
4 Posts
1
December 20th, 2020 06:00
Had to change my account since I can't log in with a google account anymore - I get an empty Dell window
So good, guess we have a 32Gig memory module number that works with Dell t7500.
I'm staying on my 192Gig configuration - it's around exactly what I need (I constantly have 140Gig in use, during rendering it tops up to 190) - 384 would be maybe better, but a speed drop of 25% for more memory might actually be noticeable AAAAANNNNNDDDD
... for anyone like me who hasn't thought about it before....
.. what are you eventually going to upgrade to?
Ryzens top up at 128Gigs of RAM.
Threadrippers aren't much better - the chip theoretically can use up to 2TB but there is no board in existence that can take it. The most you can count on is 256GB!!!!
Oh you'll go double Xeons or maybe Epics??
Well then you'll be buying DDR4 memory with 256GB for around $2000 :))) Let's go for 1TB - 8k USD :))))
So here we're talking about a 7 year old system that can be filled up to 384GB of RAM for around $400-$500, and the new system that you'll eventually get will have a measly 256GB for $2000!!!!
I would slit my wrists upgrading to a newer faster machine that costs half of my car and getting less RAM than in my old build
So yeah, 192GB seems to be my sweet spot
imickey503
3 Posts
0
March 26th, 2024 23:47
THANK YOU for all those that have contributed to this thread!
I have been wanting to max out the T-7500 platform for a while now.
Just got another one a few weeks ago, and am starting my EOL'ed build.
With Windows 10 being phased out in 2025, I thought I would give this old girl some new tricks as I got the Box for less then $21 bucks with some very midrange quad core Xeons.
I'm going to look into the 16 & 32GB memory kits this next month.
So this is a real help.
I know the last post was almost 4 years ago, but all this info sure helps out so thank you!
Plan is to shoehorn some M40 24GB Tesla cards and use it for stable diffusion & A.I. tasks that predominantly live on the GPU.
But right now? I really am just a person that just surfs the web and messes around with old hardware for pure enjoyment & Curiosity.
I've seen that 32GB of LRDIMM's (Load reduced DDR-3) go for a $284 bucks on ebay as of circa 2024 for a max of 12 sticks of it, bringing up the max to 384GB of RAM.
I want to use something like PrimoCache to see just what the system can do when doing daily tasks such as web browsing and watching YouTUbe Videos & other daily activities.
I don't really need the system, but its just fun being able to max out something much like you would souping up a car.
So that's really what it's all about for me.
I'll start a build thread with YouTube Videos and a I.G so anyone can follow along in the future as I think pushing these old systems is quite a bit of fun.
And it's gotten economically viable to do so in current year.
Look forward to other people giving more info on their memory max out builds and will be watching the thread.
Again, thanks to all who have contributed.