From the pronunciation of African slaves, of unknown ultimate origin. Possibly a corruption of bandore (from Spanish bandurria), alternatively from a West African language such as Mandinka banjul, or Kimbundu mbanza.
Practice speaking and memorizing "banjo" and many other words and sentences in English.