Search papers, labs, and topics across Lattice.
This paper introduces Neural Pub/Sub, a federated broker substrate for edge-cloud computing that uses market-based price signals for self-organization and resource allocation across autonomous domains. The system employs a MAPE-K control loop incorporating health monitoring, marginal-cost analysis, placement planning, federated dispatch, and bounded-staleness price signals, anchored in a Walrasian convergence proposition. Experiments on a federated edge-cloud testbed demonstrate that the federated market outperforms a single-process oracle by 2-4% and maintains completion rates under stress, while also withstanding broker death and network partitions.
Decentralized, market-based resource allocation in edge-cloud computing can actually *beat* centralized orchestration, even when faced with broker failures and network partitions.
The edge-cloud computing continuum demands self-management mechanisms that scale across autonomous administrative domains while honouring tenant- and operator-specified data sovereignty. We present Neural Pub/Sub, a federated-broker autonomic substrate whose self-organising behaviour emerges from market-based price signals rather than centralised control. Its MAPE-K control loop closes over per-broker health and load monitoring, marginal-cost clearing-price analysis, placement planning over a polymatroidal feasibility region, federated cross-domain dispatch, and shared peer subscription summaries with bounded-staleness price signals. The Plan step is anchored in a Walrasian convergence proposition: under gross-substitutes valuations on tree and series-parallel service-dependency DAGs, decentralised price-based allocation matches the welfare of a centralised oracle. We evaluate the substrate on a 4-VM, 4-domain, 48-worker federated edge-cloud testbed (single data centre, 50 ms emulated WAN) in a 1005-run campaign augmented by a fair-process-count sharded-oracle comparator. The federated market dominates a single-process oracle by 2-4% with 45 of 45 per-seed wins (sign-test p ~ 2.8e-14, Hodges-Lehmann median -39.6 ms); against a four-shard centralised orchestrator at equal process count the gap stays within +/-1.5% across all nine (pipeline, load) cells. Round-robin completion rate collapses 98.8% ->22.4% ->3.3% across arrival rates 5/10/15 pps while the market preserves completion; the advantage decomposes into three Walrasian properties (information completeness, admission control, price discovery). Federation withstands broker death and network partition (completion rate>= 98.7% across 75 cells), and sovereignty enforcement adds no measurable runtime overhead across 60 governance-grid runs. Heterogeneous-domain stressors and cross-site WAN deployment remain future work.
