I have set up openclaw on my slightly older server that has no GPU, but 64GiB RAM. I tried with various different models, and I think I now found something that works ok.

The problem is of course that most models are censored, and I can only run small models of which most don’t work that well with openclaw. I have arrived at ollama/huihui_ai/Qwen3.6-abliterated:35b, which does work quite well. It’s a mixture of experts model, so responds fast even though it is quite big. Responses to simple prompts come after a minute, more complex maybe take ten, or sometimes even more. But for me that’s fine, given that I’m just using unused computation.

One issue with this model is of course that it is Chinese, and it does for example avoid the topic of the Tiananmen Square Massacre. But I’m not intending to talk about this kind of heavy stuff with it, so it’s not that bad. And when asked directly, it also searches the web for information about it.

For roleplaying it works quite well so far. I am still testing out the tool calling capabilities.

Before I tried ollama/huihui_ai/gemma-4-abliterated:26b, but while it talked nicely, it was bad at calling tools and updating e.g. the SOUL.md and IDENTITY.md file, and also tried to write information about me into the IDENTITY.md file instead of the USER.md file. So I looked for alternatives.

But I am interested in your setups. What models work well for you, and what kind of hardware do you use for them? Do you have any experience to share, or any tips you can give?

  • ZeldaFreak@lemmy.worldEnglish
    151·
    1 day ago

    There is an ERP (erotic role play) Benchmark: https://huggingface.co/spaces/overhead520/Unhinged-ERP-Benchmark?not-for-all-audiences=true You may also interested in software that is more ERP capable. 2 options would be Marinara Engine and SillyTavern. There you pair a model, a character card, your persona card, lorebooks and presets. What is that? A character card are the character, the AI plays. Being it a specific character, a world or a scenario. A persona is structured like a character card, but the purpose is that you are this character. Best practice is only to fill this card with stuff the character knows or sees about you.

    A lorebook is additional information about the world or items. For example Marinara Engine can be used for RPG roleplay and in a lorebook you can explain weapons and items in details. This saves tokens, as these information only get pulled from the lorebook and send to the AI, when it get’s triggered by keywords.

    Presets are the structure. It tells the AI how to output stuff and so on. These can contain soft jailbreaks. https://rentry.org/freaky-frankenstein-presets Freaky Frankenstein is one I use (FF5 Micro) and there you can set up a lot of things. But of course you can download other presets, that do fit you more or you write your own.

    You must do research which presets work with which model and how far you can go and what you want and what you like. I use GLM 5.1 with FF5 Micro. I tried Deepseek but it was slower and I didn’t liked the output as much.

    And now a comment to people who are disliking this: As long as you do treat it more as porn replacement and not as replacement for real human interactions, I find this good. Porn videos did killed the imagination and goes more back to erotic literature, which does require you to do more mentally. With AI you can choose your setting and boundaries and aren’t on other humans to do ERP. I never did ERP with other humans, but I’m pretty sure you can’t just close the chat window, when you are satisfied and let the other person hanging.

    Also with both Marinara Engine and Silly Tavern, you don’t need to go sexual. Marinara does support games. I didn’t used it much yet. I tried the RPG function once. I didn’t had a char card, that was optimized to it. And the thing is, I have zero RPG experience. I never had friends who played DnD or pen and paper. But apparently Marinara does support this and they added a Multiplayer function. This way the AI can do the GM or other players. I don’t have much information for this, as I didn’t found a good resource jet, which explains me stuff and does recommend me fitting char cards to use.