Search papers, labs, and topics across Lattice.
This paper introduces T3R, a novel approach for deeper test-time adaptation in Graph Neural Networks (GNNs) that addresses performance degradation under distribution shifts without requiring labeled data. By utilizing multiple Rotograd matrices and a rotation technique to enhance task affinity and create surrogate gradients, T3R enables more comprehensive weight updates across the model architecture. Empirical results demonstrate that T3R significantly reduces mean absolute error (MAE) and improves classification performance on cross-domain benchmarks, showcasing its potential for real-world applications where traditional fine-tuning is impractical.
T3R achieves a remarkable 9.37% relative improvement in classification tasks by enabling deeper adaptation of GNNs at test time, even with unlabeled data.
Graph Neural Networks (GNNs) deployed in real-world systems typically have fixed weights, often leading to degraded performance under distribution shifts. This issue can be mitigated by conventional fine-tuning, but in many real-world cases, collecting labeled data is expensive or infeasible. A potential approach is Test-Time Training (TTT), which adapts models' weights using unlabeled test data, yet it is typically limited to shallow updates that affect only a subset of model parameters. We propose T3R, leveraging multiple Rotograd matrices to improve task affinity between the target and auxiliary tasks, essential for effective test-time training. T3R further introduces a rotation technique that reorients self-supervised signals using these matrices to create surrogate gradients for the target task, allowing deeper adaptation across nearly the entire architecture. Empirically, T3R reduces MAE by 0.172 points over standard inference in regression datasets and achieves at least 9.37% relative improvement on cross-domain OGB classification benchmarks compared to models without adaptation. These results highlight the potential to develop an adaptation pipeline for graph-based systems, particularly in settings where conventional fine-tuning or retraining is infeasible.
