Search papers, labs, and topics across Lattice.
To address the severe qubit constraints of near-term quantum devices, this paper evaluates a hybrid quantum-classical NLP pipeline that compresses 768-dimensional pretrained sentence embeddings down to 3–8 features for variational quantum classification. The study systematically compares unsupervised compression against supervised metric learning to determine whether extreme dimensionality reduction fatally compromises semantic representations. While variance-based PCA collapses to 57.9% accuracy at 5 dimensions, supervised LDA achieves 85.3% accuracy with just 5 qubits on TREC question classification, matching the performance of a full 384-dimensional classical baseline.
Supervised compression can shrink 768-dimensional language embeddings down to just 5 dimensions without accuracy loss, allowing 5-qubit variational circuits to match full-scale 384-dimensional classical baselines.
Large language and sentence-embedding models provide rich semantic representations, but their high dimensionality poses a challenge for near-term quantum machine learning (QML), where quantum circuits can process only a limited number of input features. We investigate a hybrid quantum-classical pipeline that transforms high-dimensional sentence embeddings into compact representations for variational quantum classification. The workflow combines a pretrained sentence-embedding model, dimensionality reduction, angle encoding, a variational quantum circuit (VQC), and a classical decision layer. We systematically compare principal component analysis (PCA), neighborhood components analysis (NCA), and linear discriminant analysis (LDA), covering both unsupervised and supervised dimensionality reduction. Using the TREC question-classification dataset, we study the relationship between representation dimensionality, information retention, qubit count, and classification performance. Preliminary PCA experiments reveal a strong information bottleneck: reducing 768-dimensional embeddings to 3, 4, 5, and 8 dimensions retains about 8.2%, 10.2%, 11.9%, and 16.4% of the variance, with corresponding classification accuracies of 50.3%, 51.2%, 57.9%, and 63.4%. In contrast, supervised reduction is substantially more efficient. LDA reaches 85.3% accuracy and NCA reaches 83.1% using only 5 dimensions, under a leakage-free cross-validation protocol, compared with 85.1% for a full 384-dimensional classical baseline. These results indicate that supervised dimensionality reduction can preserve task-relevant information far more effectively than variance-based compression, making compact representations a promising route toward practical hybrid quantum-classical NLP models.
