Pengwenlong Gu

CEDRIC - ROC

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Reasoning & Chain-of-Thought (1)Scaling Laws & Emergent Abilities (1)

Frequent co-authors

Davide Avesani (1)S. Skaperas (1)Stefano Secci (1)

Papers (1)

Sep 17, 2026

CEDRIC - ROCSep 17, 2026

The Life of a Token: from Words to Bits on the Wire

This tutorial aims to walk the reader through the journey from words to network traffic, shedding light on how language is translated into communication flows within HPC training systems, and tries to demystify how words travel across the network.

Davide Avesani, Pengwenlong Gu, S. Skaperas +1

Architecture Design (Transformers, SSMs, MoE)Reasoning & Chain-of-Thought Scaling Laws & Emergent Abilities

Pengwenlong Gu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)

Search

Pengwenlong Gu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)