On page 7-10 of the ARRL Antenna Book 20th Edition, there is a discussion
of "Off-Center-Fed Dipoles". It shows a dipole 130 feet long, fed 45.3
feet (a bit over 1/3 wavelength) from one end with a 4:1 balun, then coax
to the shack, and used on 80 thru 20.

I'm wondering if I can feed that with ladder line instead of coax and
balun.

It's not a "balanced" antenna (if there even is such a thing in the real
world) so maybe ladder line isn't a good choice here, but it would make
the installation a bit easier...