Search papers, labs, and topics across Lattice.
This study investigates the aggregation of readiness assessments for AI and robotics across various sectors, revealing significant disagreement among respondents regarding perceived preparedness for identical challenges. By analyzing 15,200 evaluations from 982 respondents, the authors find that a substantial portion of variation in readiness scores is attributed to individual differences rather than the challenges themselves. The results highlight the inadequacy of single-score summaries, suggesting that readiness reporting should reflect application-level disagreements and the diverse perspectives that contribute to average scores.
Sector readiness scores mask significant individual disagreement, with 60% of variation stemming from personal perceptions rather than the challenges themselves.
AI and Industry 4.0 readiness assessments often summarise preparedness using a single score for an organisation, application domain or sector. Those summaries can conceal disagreement about the same technology and variation among applications grouped under one sector label. We test how much information is lost through this aggregation using a card-based survey in which 982 respondents provided 15,200 readiness evaluations across 17 named AI and robotics challenges. Readiness is perceived community preparedness and available resources, not personal willingness or audited organisational capability. Respondents frequently disagreed about identical challenges, with card-level readiness standard deviations of $1.03$-$1.26$ on a five-point scale. A crossed decomposition attributes 32.7% of observed variation to stable respondent differences, 7.3% to differences among challenges, and 60.0% to response-level variation that also contains measurement error. Differences among challenge-family means account for only about 2% of variation, with substantially more variation among people, applications and person-family judgements. Manufacturing has the highest mean readiness, yet shop-floor robotics, process-optimisation AI and general decision-support applications are judged differently. Computer-science and AI/ML respondents report higher readiness than non-technical respondents across challenge families, whereas engineering respondents do not report higher Manufacturing readiness. Sector rankings are therefore best used as portfolio summaries rather than evidence that an industry is uniformly ready or behind. Readiness reporting should retain application-level disagreement, disclose whose judgements form the average, and consider ethics, cyber security, literacy and capability needs without collapsing them into a single score.
