KV-cache offload on HPE ProLiant Compute DL380a Gen12, HPE Alletra Storage MP X10000 and Intel® QAT

Platform

Key results

How the KV cache moves

Results

Tiers

Users

to

At

System metrics

System under test

HPE ProLiant Compute DL380a Gen12 server

Compute HPE ProLiant Compute DL380a Gen12

Intel® Xeon® processor badge

Processors Intel® Xeon® 6787P with Intel® QAT

HPE Alletra Storage MP X10000

Shared KV storage HPE Alletra Storage MP X10000