Here's what rhymes with windowless.

Consider these alternatives

dank / bank cubicle / cubical hallway / doorway spacious / basis soundproof / use storeroom / ballroom drab / at unheated / treated walled / called squalid / knowledge room / whom crammed / land hallways / always playroom / dayroom encased / based