I agree that, oftentimes, the user impact is harder to see than with feature development, so perhaps “direct” isn’t the best way to describe user impact.
Tech debt affects end users in all sorts of ways — stability, load times, time to resolution for bugs, and time to deliver new features being a few. It’s in this light that I say that tech debt should be done with an eye on end user impact.