Cross-lingual representation learning is animportant step in making NLP scale to allthe world’s languages. Previous work onbilingual lexicon induction suggests that itis possible to learn cross-lingual representationsof words based on similarities betweenimages associated with these words.However, that work focused (almost exclusively)on the translation of nouns only.Here, we investigate whether the meaningof other parts-of-speech (POS), in particularadjectives and verbs, can be learned inthe same way. Our experiments across fivelanguage pairs indicate that previous workdoes not scale to the problem of learningcross-lingual representations beyond simplenouns.