Search papers, labs, and topics across Lattice.
This paper introduces the Ordered Structural Dependency Hypothesis (OSDH), which posits that multiple admissible orderings of observations can uncover complementary structural dependencies in data. To implement this hypothesis, the authors develop the Independent Structural Expert Principle (ISEP), training projection-specific sequence models independently and integrating their outputs through a fusion model. Experiments with Structural Evolution RNNs (SE-RNNs) demonstrate that leveraging multiple ordered projections significantly enhances performance on complex datasets while maintaining competitiveness on simpler ones.
Multiple ordered projections can reveal hidden structural dependencies that single sequential models miss, enhancing RNN performance on complex tasks.
Recurrent neural networks (RNNs) are widely used for sequence learning, yet their application is commonly associated with temporal data, although recurrent computation fundamentally operates on ordered sequences rather than on time itself. Building on this observation, we introduce the Ordered Structural Dependency Hypothesis (OSDH), which proposes that multiple admissible orderings of the same observations may reveal complementary structural dependencies inaccessible through a single sequential organization. To operationalize this hypothesis, we propose the Independent Structural Expert Principle (ISEP), whereby projection-specific sequence models are trained independently before their learned representations are integrated through a dedicated fusion model. As a concrete realization, we present Structural Evolution RNNs (SE-RNNs), which employ conventional RNNs as projection-specific structural experts while preserving the underlying recurrent computation unchanged. Proof-of-concept experiments on three synthetic datasets with substantially different levels of structural complexity demonstrate that the proposed architecture consistently benefits from multiple ordered projections when hidden structural dependencies are present, while remaining competitive on simpler datasets. Since OSDH is independent of the underlying sequence-processing model, the proposed framework naturally extends beyond recurrent networks and may be instantiated using alternative architectures. The results suggest a general computational perspective for exploiting complementary ordered representations across diverse structured learning problems.
