As AI inference strains server memory, Marvell Technology, Inc. and Penguin Solutions, Inc. are designing a photonic server to share capacity between data center racks, with sampling planned for the second half of 2027.
Penguin also introduced its MemoryAI Photonic Appliance. The planned unit is designed to hold up to 16 TB of DDR5 RDIMM and 576 GB of HBM3E, with a total bandwidth target of 57.6 terabits per second. Penguin plans to sample it with selected customers in the second half of 2027.
The companies said Nov. 16 that the joint server would bring Marvell’s Photonic Fabric modules and network interface cards together with Penguin’s MemoryAI appliances and ComputeAI systems. They are designing the system for memory pools on a petabyte scale. Its optical connections are intended to provide high bandwidth and low latency across racks.
Marvell’s previously outlined optical memory module is part of the proposed design. The companies say sharing memory across racks would let data center operators add capacity without increasing computing hardware at the same rate.
The companies say an AI node may need hundreds of gigabytes of memory, or sometimes terabytes. They cite larger models and longer interactions, which increase the information held in key-value caches for reuse while a model generates an answer. Penguin also points to physical limits on the high-bandwidth memory that can sit beside a graphics processor.
In Marvell’s announcement, Jihoon Han, senior technology and market analyst for memory at Yole Group, said manufacturers cannot quickly increase memory output without heavy investment. He said higher memory prices are raising the cost of AI infrastructure.
The partners are also developing Penguin’s SMART CXL add-in card for reused server DDR4. It would use Marvell’s Structera X controller to connect memory recovered from retired servers through PCIe 5.0 and Compute Express Link (CXL) 2.0. The companies expect the cards to become available by the end of 2026 for qualification and deployment by enterprise customers.
The next planned step for the photonic products is sampling in the second half of 2027, both for Penguin’s appliance with selected customers and for the joint server.



