Search papers, labs, and topics across Lattice.
This paper investigates a hybrid human-AI service system where tasks are processed by an automated chatbot followed by human agents, focusing on optimizing resource allocation for task resolution. The authors introduce the UCB-DPP policy, which effectively balances the tradeoff between automation costs and human congestion by leveraging Upper Confidence Bounds and Drift-Plus-Penalty control to adaptively learn success probabilities and service rates. Results demonstrate that UCB-DPP achieves a regret of $\widetilde{\mathcal{O}}(K\sqrt{T})$ and ensures stability in human-service queues, outperforming existing baselines in simulations.
Balancing automation and human intervention can significantly enhance efficiency in service systems, with the UCB-DPP policy proving to be a game-changer in managing this tradeoff.
We study a human-AI service system in which tasks arrive sequentially and are processed through a two-stage architecture: an automated chatbot followed, when necessary, by a human agent. We consider $T$ sequentially arriving tasks, each belonging to one of $K$ heterogeneous types. For each task the decision maker chooses how many resources to allocate to the chatbot, whose type-dependent success probabilities are initially unknown. Tasks not resolved by the chatbot enter type-dependent human-service queues, where they are processed by a human agent with unknown service rates. This model captures a central tradeoff in hybrid service systems: relying more on automation reduces human congestion but increases chatbot costs, while insufficient automation may overload the human agent. We propose the UCB-DPP policy, which combines Upper Confidence Bounds with Drift-Plus-Penalty control to learn the unknown parameters of the system while making queue-aware decisions. We prove that UCB-DPP achieves regret $\widetilde{\mathcal{O}}(K\sqrt{T})$ and guarantees mean-rate stability of the human-service queues. Simulations on synthetic instances show that the proposed policy outperforms natural baselines.