Here's what rhymes with continually.

Consider these alternatives

whenever / never again / then striving / driving always / hallways keep / deep routinely / extremely anew / to systematically / automatically reinvent / went altered / ordered slowly / holy shifting / existing amazed / based innovate / state lately / greatly