Search papers, labs, and topics across Lattice.
The Dark Souls Learning Environment (DSLE) is introduced as a benchmark platform for evaluating game-playing agents against all 22 boss encounters in Dark Souls: Remastered, utilizing a Gymnasium-style interface that incorporates real-time combat and high-dimensional visual input. The study evaluates various agent strategies, including a random policy, an expert system, and reinforcement learning methods like PPO and DQN, revealing that while the expert system and evolutionary baseline achieve some success against the tutorial boss, none of the agents demonstrate effective learning across the broader set of encounters. Notably, the agents struggle significantly in complex scenarios, with PPO and DQN showing negligible performance, highlighting the challenges of training agents in high-stakes, dynamic environments.
Despite advanced strategies, no agent could consistently conquer the diverse challenges of Dark Souls bosses, revealing critical limitations in current AI training methods for complex game environments.
We introduce the Dark Souls Learning Environment (DSLE), a containerized platform that presents all 22 boss encounters of Dark Souls: Remastered as game-playing agent benchmarks through a Gymnasium-style interface. DSLE combines real-time combat, high-dimensional visual input, and sparse terminal rewards, with each environment step being a real action executed against the running game. To support controlled comparison, we define DSLE-5, a representative five-boss subset, spanning a melee fight, a spatially constrained arena, an environmental-hazard fight, a multi-target fight, and a fast final-boss fight, that we recommend as the starting suite for agents built on DSLE. On DSLE-5 we evaluate a random policy, an expert system, an evolutionary baseline, and PPO and DQN agents trained from visual input. The expert system and the evolutionary baseline each defeat the Asylum Demon, the game's tutorial boss (63% and 43% peak win rates), but none of the five methods defeats the other four DSLE-5 bosses; PPO and DQN show no measurable learning (at most 0.33% win rate on the tutorial boss, 0% elsewhere) within a budget that already costs tens of wall-clock hours per run. A broader study running the evolutionary baseline across all 22 encounters under advantaged all level-50 stats yields wins on only a handful of additional early-game bosses and leaves the rest unwon. The failure cases range from sub-10-second deaths in cramped, multi-target encounters to minute-long stalemates that inflict almost no damage, and we report them through survival time and damage dealt rather than win rate alone.