Here's what rhymes with penaltye.
by die buy tie bi bye dye pi pie thai dei ty tai my high why dry lie thy try y guy nearby vi hi shy sigh chi fi hy nigh spy thigh vie ly ply psi quae rye wir awry hai lye mai muy nai pry tri trie wry cy fy kai lai luy mei pri sy thei untie wai phi sty amebae stye apply cry fly reply sky thereby deny rely whereby hereby defy fry sly alibi nullify belie lullaby pupae amoebae aquae retry spry turfy lanai ripply slier supply imply occupy comply multiply nuclei goodbye underlie ratify decry terrify typify dignify edify mollify mortify bonsai deify triply ultrahigh mummify gentrify banzais overbuy yuppify identify justify stimuli modify specify alkali signify simplify testify verify butterfly certify gratify notify alveoli amplify fortify pacify rectify standby unify beautify solidify termini codify descry overlie ramify resupply vilify acidify firefly mystify ossify stultify blowfly emulsify horrify misapply petrify stupefy overfly scurfy versify barfly prettify shanghai drachmai syllabify dandify satisfy clarify qualify classify glorify intensify purify magnify samurai falsify indemnify crucify liquefy oversupply personify demystify preoccupy stratify vivify calcify reunify liquify scarify vitrify beatify refortify speechify exemplify quantify diversify objectify dragonfly electrify revivify cumuli dissatisfy hyperbolae solemnify disqualify oversimplify detoxify reclassify declassify misidentify transmogrify