Inherited from Middle English happely, hapliche, happeliche; equivalent to hap + -ly.
Practice speaking and memorizing "haply" and many other words and sentences in English.