From Middle English choisly; equivalent to choice + -ly.
Practice speaking and memorizing "choicely" and many other words and sentences in English.