I don't think you will be able to have the type of research program that you seem to imagine.
Working in the summers only will mean no students or technicians. It will also mean that it will not be possible to obtain grant funding. If the reason you can't get grant funding is not clear, I will elaborate.
You will have 3 months at best to work on a project in someone else's lab, which will be something like a part time postdoc.
This is probably not what you want to hear, but I think the reality needs to be spelled out, or you will end up with expectations that are impossible to meet.
I am ok with that. My original post mainly asked about differences related to teaching NOT research. The thread got side tracked into research.
My previous SLAC had zero options for the kind of research I am interested in over the summer (faculty or students who would be interested in my area). A part time post doc option at least helps me do some research.