Michael Abraham, Director of Product Management at Micron, discusses data center challenges, the memory and storage hierarchy, Micron CZ120 memory modules, database (TPC-H) improvements, AI inferencing improvements, and how to enabling in your company.
2. 2
1. Data center challenges
2. Memory and storage hierarchy
3. Micron CZ120 memory module
4. Database (TPC-H) improvements
5. AI inferencing improvements
6. Enabling in your company
3. Higher Capacity More Bandwidth Lower Data Center TCO
In-Memory Databases, SaaS, AI
training and inference, General
Purpose compute continue to grow
exponentially, requiring
unconstrained memory capacity to
enable compute to continue to
scale.
The explosion of processor core
counts and the real-time nature
of business is necessitating
memory in the data center to
provide faster data access to
keep compute fed. to keep
compute fed
Data center operators drive to
optimize TCO to deliver the exact
server memory capacity and
bandwidth that workloads require.
Data Center Challenges
Scaling for today’s data center growth plus tomorrow’sAI disruptive needs
6. 6
Introducing Micron CZ120 Memory
Delivering capacity, bandwidth, flexibility
128GB / 256GB
Up to 2TB incremental server capacity supporting CXL 2.0
36GB/s
Up to 34% increased server memory bandwidth
memory bandwidth per module using PCIe® Gen5 x8
E3.S 2T x8
Industry-standard form factor for broad deployment
1. By adding 8x256GB CZ120s, system limitations apply
2. Memory Latency Checker bandwidth compared to 12-channel 4800MT/s RDIMM server
2
1
7. 7
TPC-H: DRAM vs. Software-tiered memory
CXL improves MSSQL performance of both 64GB and 96GB RDIMMs by 60% or more
CXL can provide better performance for capacity intensive workloads
9. Learn more about CXL™ and
Micron CZ120
Qualify your server platforms by enrolling in the
Micron Technology Enablement Program (TEP)
and leverage our world-class collaboration
▪ Hands-on support to aid in the development
of CXL-enabled designs
▪ Technical resources including data sheets,
electrical and thermal models to aid in product
development and evaluation, and engineering
consultation related to signal integrity and
other technical support topics
▪ Access to other ecosystem partners who can
aid in system-level design
Learn more www.micron.com/CXL
9