Search papers, labs, and topics across Lattice.
BtrLog is a novel cloud logging service designed to address the limitations of existing write-ahead logging (WAL) solutions in cloud database systems by providing low-latency durable appends and cost-effective archival. It achieves this by replicating log records across a quorum of SSD-backed nodes in a single network round trip, significantly reducing commit latency and enhancing transaction throughput. Evaluation results demonstrate that BtrLog outperforms traditional options like EBS in terms of latency while enabling higher end-to-end transaction throughput when integrated into a database management system (DBMS).
BtrLog slashes commit latency and boosts transaction throughput, outperforming traditional cloud logging solutions like EBS.
Cloud database systems cannot rely on instance-local disks for write-ahead logging (WAL) durability, forcing WAL onto remote storage. Existing options are unsatisfying: remote block storage like EBS is easy to adopt but adds substantial write latency and cost, while object storage offers excellent durability and low storage cost but is impractical for OLTP due to high latency and per-append cost. Many cloud-native databases, therefore, depend on purpose-built logging backends, which are typically proprietary and tightly coupled to engine-specific replication and recovery protocols, limiting reuse. We present BtrLog, a reusable cloud logging service that combines low-latency durable appends with low-cost archival for the common single-writer architecture. BtrLog replicates log records across a quorum of SSD-backed log nodes in a single network round trip, reducing sensitivity to stragglers in commit latency. To minimize storage cost, log nodes archive records to object storage as large segments, which are written asynchronously and off the latency-critical write path. In our evaluation, BtrLog achieves lower latency than EBS and enables higher end-to-end transaction throughput when integrated into a DBMS.
