Here's what rhymes with supply.
apply dry lie try ly ply rye lye pry tri trie wry lai luy pri by my high why die thy y buy cry fly guy tie vi hi shy sigh bi bye chi dye fi hy nigh pi pie thai thigh vie dei fry psi quae sly ty wir awry hai mai muy nai belie cy fy kai mei sy tai thei wai phi spry slier reply sky deny imply rely comply defy spy underlie decry pupae untie overlie resupply sty aquae firefly retry amebae misapply stye turfy lanai overfly ripply thereby nearby whereby hereby butterfly certify goodbye alibi samurai terrify amoebae descry edify oversupply bonsai deify ossify triply ultrahigh blowfly stupefy scurfy versify barfly shanghai vitrify drachmai banzais overbuy yuppify justify occupy satisfy modify multiply nuclei alkali simplify verify notify purify alveoli amplify fortify nullify pacify ratify standby unify beautify lullaby solidify termini typify codify mollify ramify vilify acidify stultify vivify horrify petrify scarify hyperbolae mummify prettify speechify syllabify stimuli clarify qualify specify classify signify testify glorify gratify rectify falsify crucify dignify liquefy mortify mystify stratify calcify reunify liquify beatify gentrify refortify dandify identify exemplify quantify diversify magnify objectify oversimplify personify dragonfly electrify preoccupy emulsify revivify cumuli dissatisfy declassify solemnify intensify disqualify indemnify demystify detoxify reclassify misidentify transmogrify