Sillytavern api reddit.

Sillytavern api reddit Second choice: TogetherAI. , which can be a bit confusing. py--enable-modules=sd-remote when using the sillytavern-extra. After using Cohere's playground and thinking it was pretty good, I wanted to play with it on SillyTavern. local LLM, Faraday, and NovelAI api, but nothing came close to what chatgpt offers in terms of quality. 8 which is under more active development, and has added many major features. At this then run the script with bash install-poe-api-server. Sillytavern doesn’t use the model directly, it just tells kobold what you type, formatted in a way that kobold and the model it’s running can understand. I can successfully connect the API to the URL and I have a model loaded into Kobold. Click it. 11. A place to discuss the SillyTavern fork of TavernAI. Use Kobold Horde for free to figure stuff out like how to use SillyTavern’s functions (use an api key, it’s free and easy, gives you priority access). I have Stable Diffusion set up to run with --api so that I have something to send to the extras extension, but the extras extension just has the red text that says "Could not connect to API". I wanted to use Silly Tavern with a TheBloke model from hugging face while on my laptop, so I quickly coded a simple Google Colab that gives you the required API key for SillyTavern. Other APIs work such as Moe and KoboldAI Horde, but KoboldAI isn't working. For immediate help and problem solving, please join us at https://discourse. Claude's api with jailbreaking system prompts and output prepending is best option for rp I have tried. what other good free ones are there? Dec 17, 2024 · If it's OpenAI compatible can anyone tell me what my API key should look like as the URL. Learn more: https://sillytavernai **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Their give you a lot of model to use on their site and their API, like mixtral 8x22 or WizardLM2 8x22 which is very good at RP. So to put it simply: No. I cannot, for the life of me, figure out why it isn't working. 2. Mar 20, 2025 · What it offers: * 405B parameter model trained in-house specifically optimized for roleplay and creative writing * Fully compatible with OpenAI API format (works with existing frontends/workflows) * No content moderation or logging of user prompts or model responses * Detailed SillyTavern setup instructions at https://docs. Sign up with Cohere on their website, get a free trial key. Edit: I got it to finally work. # API Connections. py. Mar 20, 2025 · Just wanted to share that Realmplay’s API is now generally available with full SillyTavern integration! What it offers: * 405B parameter model trained in-house specifically optimized for roleplay and creative writing * Fully compatible with OpenAI API format (works with existing frontends/workflows) * No content moderation or logging of user prompts or model responses * Detailed SillyTavern **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I believe someone did something similar for ControlNet a few months ago: ControlNet add-in for SD Extension : SillyTavernAI (reddit. here --port port -ngl gpu_layers -c context, then set the ip and port in ST. sh. Is there a way to do something like this, or should I just put the the prompts and all that and put them somewhere else that will properly work with Discord? **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Launch the server with . 002 for every 1000 tokens. Open SillyTavern from another terminal or new termux session and do this: A place to discuss the SillyTavern fork of TavernAI. I have tried launching the extras server with the simple launcher's UI, but I don't see anything new happening in the command prompt. If you used the script I mentioned before, just run bash start. ai. Basically i haven't tried to use Claude after the whole Poe thing awhile back and was wondering what the best ways to get a Claude api key or some other way to use it for SillyTavern after Poe stopped being officially supported? We would like to show you a description here but the site won’t allow us. In ST top left icon (3 bars?) is the setting for what you send via the API calls, at the bottom of this menu you can turn off sending the Jailbrake and NSFW system data. After, mancer. If you did not use it just run python app/app. Yes you need to generate a key. Once that's done or If you're already up to date then in the menu where you select API connect to OpenRouter as usual and then click on "Force Instruct Mode Formatting" This will make OpenRouter models listen to the Instruct Mode. It will not have a filter. Copy it and make sure to save it somewhere secure as you will not be able to see the full thing again. cpp option in the backend dropdown menu. Open SillyTavern from another terminal or new termux session and do this: **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I tried Mancer,. Can access easily by their API (Cohore). realmplay. But it doesn't seem to want to connect. 5 turbo is $. Free cohere's commandr+ api is good too. Lightweight Exllamav2-based API with streaming; Supports Exl2, GPTQ, and FP16 models; Official extension allows loading/unloading models directly from SillyTavern; Not recommended for users with low VRAM (no CPU offloading) GitHub use the following search parameters to narrow your results: subreddit:subreddit find submissions in "subreddit" author:username find submissions by "username" site:example. # TabbyAPI. i've been using it for a while, and have had no problems! sometimes the characters or the ai in general freaks out a bit and reacts differently then normal. But the moment I try to verify API connection using the test message, it comes back as "Could not get a reply from API. SillyTavern has very serviceable presets, so no problem there. You can change the API hosting port with the --api-port 5001 flag, where 5001 is your custom port. Usually you can get a free trial of $5 worth of tokens. x. The documentation suggests that using the Main API for summarization is preferable, as it utilizes the deployed LLM model. # ELI5: Chat Completions vs Text Completions Ever since poe has been removed, silly tavern just feels really complicated and another bad ai, and the only good ones are chatgpt but the api key is behind a paywall. practicalzfs. cpp server directly supports OpenAi api now, and Sillytavern has a llama. It may be possible to a simple Adetailer menu in the configuration, and then send these settings through the Adetailed API (API · Bing-su/adetailer Wiki · GitHub). 8 but I legit dk what to do and how to use it. In the API tab (the plug icon) you select the API you will use for image captioning and set the API We would like to show you a description here but the site won’t allow us. So much better than trying to keep something consistent in SillyTavern with twisted settings. com **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. At this And I forgot to mention that they give you 10k credits to generate images on the NovelAI site itself, and use the NovelAI site without the api which is also very interesting, I used to use it before as it was not so good the compatibility with sillytavern, but now it is very good the API together with SillyTavern. ip. and You can paste the API key in API key field. Then paste your api code into the api key. NovelAI will get actively worse to the point of incoherence if you feed it bad content. , I have 0 knowledge on coding, I just want to erp bruv, how and what API do I even install and how do I proceed from there thanks in advance A place to discuss the SillyTavern fork of TavernAI. You connect sillytavern to the kobold server with the API URL in settings. The API by default uses grok-2-1212 model for now. Choose mistral. Privated to protest Reddit's upcoming API The Summarize with MainAPI option appears to include a "summarize" button, whereas the Summarize with Extras API does not seem to provide any similar functionality. . You get 25$ free credit for creating an account (also free). Mixtral 8x22b on openrouter/deepinfra etc is good too. Reply reply More replies More replies More replies **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. silly-tavern is safe, yes! what the other posts are talking about is some other form of API, but the one you are using is perfectly safe. It is free but the moment you start using it on sillytavern, it will charge based on the prompt sent to the api and the text completed. Then in silly tavern you are going to go to api selection. No phone verification needed. At this point they can be thought of as completely independent programs. Just register account on cohere and get API key. " and "Bad Request". I need help with running the sillytavern-extra with local stable diffusion i have added the --api in the webui-user. This subreddit has gone Restricted and reference-only as part of a mass protest against Reddit's recent API changes, which break third-party apps and moderation tools. com) By the way, thank you for the useful extension! I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. 128k context. SillyTavern is a fork of TavernAI 1. Then generate your api keys. com with the ZFS community as well. Well yes, but actually no. At this **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Update SillyTavern if you haven't done so in a while. This will then allow the conversations to work correctly. We would like to show you a description here but the site won’t allow us. I have both installed and both running. I've checked, and the api is correct. Think of kobold as a web server. The better quality prose you use, the better results you'll get. The free API access is unexpectedly good with 6 request per min and 1000 request per month. and the poe server always comes back with internal server error. Instead of openrouter, use free budget on services like DeepInfra and run Mixtral 8x22b or WizardLM 8x22b. So I just installed SillyTavern 1. But when I type messages into SillyTavern, I get no responses. The charge is based on tokens, with 1000 tokens = ~500 - 750 words. Sillytavern says (could not connect to the API) i want to try out all of the features but no dice. The cost with gpt3. I've disabled the api tag, and made sure the --extension openai flag is applied. I'm using the same configuration as with the Anthropic and OpenAI APIs so I'm a bit lost. Edit: To use it on SillyTavern, You'll have to paste https://api. But I can't seem to find a way to get an API from SillyTavern (like you can with, for example, GPT4All) to put it into a Discord bot, and respond to messages from Discord. bat of my stable diffusion, i have used python server. /server -m path/to/model --host your. Now the Main Problem is that even after connecting with the API I am not getting any Reply to any messages I send to the bots **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Any help would be appreciated. You're going to choose chat completion. SillyTavern will handle the jailbreaking process so that you will be able to chat with characters without the filter interfering. Cohere's own API, which has a section under Chat Completion in the API menu in SillyTavern. The llama. Im almost to the point of making a bounty to get this shit working. I installed alltalk on my pc, everything on the installation went without error, started it and now it won't even connect to sillytavern. Dec 17, 2024 · Edit: To use it on SillyTavern, You'll have to paste https://api. With sillytavern you can use: Free Cohere CommandR+ api. You have to load the model into the web server. ai/v1 in the server URL section. Use it in SillyTavern Step 1: Run the program. Below is a description of their respective strengths, weaknesses, and use cases. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Learn more: https://sillytavernai A place to discuss the SillyTavern fork of TavernAI. SillyTavern can connect to a wide range of LLM APIs. tech is probably the best. SillyTavern itself is just an interface, it has no filter built-in. You will get very smart multilingual model for free without noticable restrictions. I've tried all 3 options, none work. It says it is processing, so it detects alltalk running, but then just gives back "error". keep in mind, all of these ai's are still a work in progress and aren't going to run perfectly :) then run the script with bash install-poe-api-server. Members Online **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Title. Yeah Claude was big months ago, people are still trying it with Slack (and getting banned), OpenAI has been cracking down on NSFW stuff, and Kobold A place to discuss the SillyTavern fork of TavernAI. but i still can't generate image using my local stable diffusion all i can see is the horde option We would like to show you a description here but the site won’t allow us. The issue I've seen for some is literally just how comfortable you are with English. If you then send the 'test message' you will see the API works on the LMS side. Then, I started exploring NovelAi interface, and wow man, it's awesome. I'm using sillytavern on mobile. Under Chat Completion Source. Getting the API key is simple. Step 2: Run & Configure SillyTavern. EDIT: When using option 2 (multimodal) it will have a dropdown to select the API to use but nowhere to enter the API address, only this: Hint: Set your API keys and endpoints in the 'API Connections' tab first. Depending on the bot/API that you use, you may encounter a filter. From my testing, it generates a response in around 8-11 seconds. fhequzf xaks pxwtdy hhnbm jhsks gkoxb arbfh lgdofv tikq xavuh