I am not a landlord, although I wouldn't mind getting into it in, perhaps, 10 or so years' time.
What is so horribly wrong with buy-to-let? Many a stalwart Labour Councillor has a tenant or two, and sometimes quite a few.
There just needs to be proper regulation, properly enforced. Like anything else.