Univerbation of bec + jaune, literally “yellow beak”. The pronunciation /be/ represents the Middle French preconsonantal form, later displaced by the prevocalic/pausal pronunciation /bɛk/, but preserved in idioms (cf. bédane).
Practice speaking and memorizing "béjaune" and many other words and sentences in French.