It is relatively uncontroversial that word meaning can give rise to behaviourally and neurally measurable phenomena even when words are perceived outside of awareness. It is less clear, however, exactly what kind of semantic information is extracted from unconsciously perceived words. We address this question by modeling word meaning quantitatively based on language use, and then testing in the lab which aspects of these computational models affects people's performance within and outside of awareness.