I’m thinking through it and I don’t think you should run a therapist off your phone either. Not even for privacy reasons, that just seems like a recipe for disaster.
EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp
I’m thinking through it and I don’t think you should run a therapist off your phone either. Not even for privacy reasons, that just seems like a recipe for disaster.
Therapist is too strong of a word for what I’m looking for.
Sometimes I just need to hear my emotions are valid without burdening anyone :(
EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp
Thanks for the links. So I don’t need to worry about downloading the model from meta eh?
Edit: oh you mean download this one instead?
I tried and the app crashes after submitting a prompt but this is a good starting point. I’ll take a look into it further later.