Search papers, labs, and topics across Lattice.
This paper explores the feasibility of inferring dietary behavior change receptivity from egocentric eating images captured by a wearable camera. A transfer-learning approach using CLIP vision encoder and a transformer classifier was used to process image sequences and extract semantic and temporal cues related to self-reported receptivity dimensions (awareness, interaction capability, and motivation). The preliminary results demonstrate improvements over baseline models, suggesting that eating episode images contain relevant cues.
Forget questionnaires – your wearable camera might reveal if you're actually ready to change your eating habits.
Accurately assessing dietary behavior change receptivity is essential for designing effective just-in-time adaptive interventions (JITAIs) that promote healthier eating habits. However, self-report-based assessment of behavior change receptivity is sparse and delayed, limiting its practical use in continuous monitoring. To explore whether passive sensing may help address this challenge, this study conducts a pilot investigation of inferring participants'self-reported behavior change receptivity from egocentric eating images collected by a wearable camera. We use pilot data obtained from free-living eating episodes using the Automatic Ingestion Monitor v2 (AIM-2). The data included egocentric image sequences captured during eating and paired with responses to questions assessing specific dimensions of behavior change receptivity (awareness, interaction capability, and motivation). To examine whether visual information contained any relevancy to these responses, we evaluated a transfer-learning-assisted framework that combines a pre-trained Contrastive Language-Image Pre-Training (CLIP) vision encoder with a lightweight transformer classifier. The model processes eating episode image sequences to extract potential semantic and temporal cues related to behavior change receptivity. Preliminary experimental results show promising improvements over simple baseline models for behavior change receptivity indicators. These early findings suggest that egocentric eating episode images may contain cues related to dietary behavior change receptivity, and warrant further investigation with larger and more comprehensive datasets.
