Probably from Vulgar Latin *carudium, from Ancient Greek καρύδιον (karúdion), from κάρυον (káruon, “nut”); alternatively, from a substrate language: compare carolo and carocha. Cognate with Portuguese caroço.
Practice speaking and memorizing "carozo" and many other words and sentences in Galician.