Default pop-up menu in JSmol 14.6.2:
Problems:
ul.jmolPopupMenu , ul.jmolPopupMenu ul { line-height:1em; }
.jmolPopupMenu input[type="checkbox"] { transform: scale(0.8); margin-top:-0.2em; }
.jmolPopupMenu ul.ui-menu { max-height:25em; overflow-y:auto; overflow-x:hidden; position:fixed; }
Sample 1 (on a 500px JSmol panel):