websockets support

[matheusfillipe]

Fix #4

rlwrap websocat ws://127.0.0.1:8000/api/stream
dk
{"error":"Invalid JSON data"}
{"model": "12111d"}
{"error":"Value 12111d not in allowed values: ['gpt-3', 'gpt-3.5-turbo', 'gpt-4o', 'gpt-4o-mini', 'gpt-4', 'gpt-4-turbo', 'meta-ai', 'llama-2-13b', 'llama-3', 'llama-3-8b', 'llama-3-70b', 'llama-3.1', 'llama-3.1-8b', 'llama-3.1-70b', 'llama-3.1-405b', 'llama-3.2-11b', 'llama-3.2-90b', 'llamaguard-7b', 'llamaguard-2-8b', 'mistral-7b', 'mixtral-8x7b', 'mixtral-8x22b', 'mistral-nemo', 'mixtral-8x7b-dpo', 'hermes-3', 'yi-34b', 'phi_3_medium-4k', 'phi-3.5-mini', 'gemini', 'gemini-pro', 'gemini-flash', 'gemma-2b', 'gemma-2b-9b', 'gemma-2b-27b', 'gemma-2', 'gemma-2-27b', 'claude-2', 'claude-2.1', 'claude-3', 'claude-3-opus', 'claude-3-sonnet', 'claude-3-haiku', 'claude-3.5', 'claude-3.5-sonnet', 'reka-core', 'blackbox', 'command-r+', 'dbrx-instruct', 'gigachat', 'sparkdesk-v1.1', 'qwen', 'qwen-1.5-7b', 'qwen-1.5-14b', 'qwen-1.5-72b', 'qwen-1.5-110b', 'qwen-2-72b', 'glm-3-6b', 'glm-4-9b', 'glm-4', 'yi-1.5-9b', 'solar-1-mini', 'solar-10-7b', 'solar-pro', 'pi', 'deepseek', 'llava-13b', 'wizardlm-2-7b', 'wizardlm-2-8x22b', 'minicpm-llama-3-v2.5', 'lzlv-70b', 'openchat-3.6-8b', 'phind-codellama-34b-v2', 'dolphin-2.9.1-llama-3-70b', 'grok-2', 'grok-2-mini', 'sonar-online', 'sonar-chat', 'mythomax-l2-13b', 'cosmosrp', 'sdxl', 'sd-3', 'playground-v2.5', 'flux', 'flux-realism', 'flux-anime', 'flux-3d', 'flux-disney', 'flux-pixel', 'flux-4o', 'flux-schnell', 'dalle', 'dalle-2', 'dalle-3', 'dalle-mini', 'emi', 'any-dark', 'prodia', 'gpt-3.5-turbo-16k', 'deepseek-llm-67b-chat', 'Qwen1.5-72B-Chat', 'gemma-2b-it', 'gpt-3.5-turbo-0125', 'llama-3-8b-chat-turbo', 'Qwen1.5-14B-Chat', 'Llama-Guard-7b', 'chatgpt-4o-latest', 'gpt-4o-mini-2024-07-18', 'gemma-2-27b-it', 'claude-3-sonnet-20240229', 'llama-2-13b-chat', 'Qwen1.5-7B-Chat', 'Qwen1.5-110B-Chat', 'llama-3-8b-chat-lite', 'llama-3.1-405b-turbo', 'gemini-1.5-pro', 'Nous-Hermes-2-Yi-34B', 'SOLAR-10.7B-Instruct-v1.0', 'LlamaGuard-2-8b', 'Llama-3.2-90B-Vision-Instruct-Turbo', 'Mixtral-8x22B-Instruct-v0.1', 'Mixtral-8x7B-Instruct-v0.1', 'claude-3-5-sonnet-20240620', 'Qwen2-72B-Instruct', 'llama-3-8b-chat', 'llama-3.1-8b-turbo', 'MythoMax-L2-13b', 'llama-3-70b-chat-lite', 'dall-e-3', 'gemini-1.5-flash', 'llama-3-70b-chat-turbo', 'llama-3-70b-chat', 'claude-3-opus-20240229', 'gpt-3.5-turbo-1106', 'gemma-2-9b-it', 'Mistral-7B-Instruct-v0.2', 'Mistral-7B-Instruct-v0.3', 'WizardLM-2-8x22B', 'Mistral-7B-Instruct-v0.1', 'Nous-Hermes-2-Mixtral-8x7B-DPO', 'claude-3-haiku-20240307', 'llama-3.1-70b-turbo', 'Precise', 'Balanced', 'Creative', 'Copilot', 'claude-sonnet-3.5', 'ImageGenerationLV45LJp', 'perplexity/sonar-online', 'meta/llama3.1-8b', 'google/gemma-2', 'mistral/mixtral-8x7b', 'mistralai/Mixtral-8x7B-Instruct-v0.1', 'meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo', 'meta-llama/Meta-Llama-3.1-8B-Instruct', 'lizpreciatior/lzlv_70b_fp16_hf', 'cognitivecomputations/dolphin-2.9.1-llama-3-70b', 'openbmb/MiniCPM-Llama3-V-2_5', 'meta-llama/Meta-Llama-3.1-70B-Instruct', 'Phind/Phind-CodeLlama-34B-v2', 'google/gemma-2-27b-it', 'microsoft/WizardLM-2-8x22B', 'Qwen/Qwen2-72B-Instruct', 'mistralai/Mixtral-8x22B-Instruct-v0.1', 'microsoft/WizardLM-2-7B', 'microsoft/Phi-3-medium-4k-instruct', 'mistralai/Mistral-7B-Instruct-v0.3', 'openchat/openchat-3.6-8b', 'phi-3-medium-4k', 'meta-llama/Meta-Llama-3.1-405B-Instruct', 'glm-4-9B', 'glm4-9B-chat', 'Yi-1.5-9B-Chat', 'Qwen2-7B-Instruct', '@cf/qwen/qwen1.5-14b-chat-awq', 'chatglm3-6B', 'SparkDesk-v1.1', 'CohereForAI/c4ai-command-r-plus-08-2024', 'microsoft/Phi-3.5-mini-instruct', 'meta-llama/Llama-3.2-11B-Vision-Instruct', 'Qwen/Qwen2.5-72B-Instruct', 'NousResearch/Hermes-3-Llama-3.1-8B', 'mistralai/Mistral-Nemo-Instruct-2407', 'command-r-plus', 'claude-3-opus-20240229-aws', 'gpt-4o-free', 'gemini-1.5-flash-002', 'claude-3-opus-20240229-gcp', 'gpt-4o-mini-free', 'gpt-4o-2024-08-06', 'gemini-1.5-pro-002', 'gpt-4-turbo-2024-04-09', 'gemini-1.5', 'dalle2', 'gpt-3.5-turbo-0301', 'davinci', 'gpt-3.5-turbo-16k-0613', 'gpt-4-0314', 'ada', 'babbage-002', 'text-ada-001', 'curie', 'sdxl-turbo', 'text-davinci-003', 'gpt-4-32k-0314', 'davinci-002', 'code-davinci-002', 'gptweb', 'gpt-4-0613', 'text-curie-001', 'babbage', 'Bing (Precise)', 'Bing (Balanced)', 'gpt-3.5-turbo-0613', 'text-babbage-001', 'text-davinci-002', 'gpt-4-32k', 'Bing (Creative)', 'auto', 'gpt-4-gizmo', 'llama-3.1-sonar-large-128k-chat', 'llama-3.1-70b-instruct', 'llama-3.1-sonar-large-128k-online', 'llama-3.1-8b-instruct', 'llama-3.1-sonar-small-128k-chat', 'llama-3.1-sonar-small-128k-online', 'blazing_drive_v10g.safetensors [ca1c1eab]', 'edgeOfRealism_eorV20.safetensors [3ed5de15]', 'neverendingDream_v122.safetensors [f964ceeb]', 'dreamshaper_7.safetensors [5cf5ae06]', 'theallys-mix-ii-churned.safetensors [5d9225a4]', 'rundiffusionFX_v10.safetensors [cd4e694d]', 'Counterfeit_v30.safetensors [9e2a8f19]', 'dreamshaper_6BakedVae.safetensors [114c8abb]', 'dreamlike-anime-1.0.safetensors [4520e090]', 'absolutereality_v181.safetensors [3d9d4d2b]', 'cuteyukimixAdorable_midchapter3.safetensors [04bdffe6]', 'sdv1_4.ckpt [7460a6fa]', 'portraitplus_V1.0.safetensors [1400e684]', 'indigoFurryMix_v75Hybrid.safetensors [91208cbb]', 'juggernaut_aftermath.safetensors [5e20c455]', 'childrensStories_v13D.safetensors [9dfaabcb]', 'Realistic_Vision_V4.0.safetensors [29a7afaa]', '3Guofeng3_v34.safetensors [50f420de]', 'anythingV5_PrtRE.safetensors [893e49b9]', 'amIReal_V41.safetensors [0a8a2e61]', 'Realistic_Vision_V5.0.safetensors [614d1063]', 'meinamix_meinaV11.safetensors [b56ce717]', 'meinamix_meinaV9.safetensors [2ec66ab0]', 'aniverse_v30.safetensors [579e6f85]', 'deliberate_v3.safetensors [afd9d2d4]', 'timeless-1.0.ckpt [7c4971d4]', 'Realistic_Vision_V1.4-pruned-fp16.safetensors [8d21810b]', 'v1-5-inpainting.safetensors [21c7ab71]', 'dreamlike-photoreal-2.0.safetensors [fdcf65e7]', 'dreamshaper_8.safetensors [9d40847d]', 'dreamlike-diffusion-1.0.safetensors [5c9fd6e0]', 'epicrealism_pureEvolutionV3.safetensors [42c8440c]', 'analog-diffusion-1.0.ckpt [9ca13f02]', 'epicrealism_naturalSinRC1VAE.safetensors [90a4c676]', 'cyberrealistic_v33.safetensors [82b0d085]', 'deliberate_v2.safetensors [10ec4b29]', 'revAnimated_v122.safetensors [3f4fefd9]', 'childrensStories_v1SemiReal.safetensors [a1c56dbb]', 'majicmixRealistic_v4.safetensors [29d0de58]', 'breakdomain_I2428.safetensors [43cc7d2f]', 'AOM3A3_orangemixs.safetensors [9600da17]', 'anything-v4.5-pruned.ckpt [65745d25]', 'elldreths-vivid-mix.safetensors [342d9d26]', 'Realistic_Vision_V5.1.safetensors [a0f13c83]', 'lofi_v4.safetensors [ccc204d6]', 'absolutereality_V16.safetensors [37db0fc3]', 'Realistic_Vision_V2.0.safetensors [79587710]', 'openjourney_V4.ckpt [ca2f377f]', 'redshift_diffusion-V10.safetensors [1400e684]', 'ICantBelieveItsNotPhotography_seco.safetensors [4e7a3dfd]', 'v1-5-pruned-emaonly.safetensors [d7049739]', 'pastelMixStylizedAnime_pruned_fp16.safetensors [793a26e8]', 'toonyou_beta6.safetensors [980f6b15]', 'breakdomain_M2150.safetensors [15f7afca]', 'protogenx34.safetensors [5896f8d5]', 'dalcefo_v4.safetensors [425952fe]', 'cetusMix_Version35.safetensors [de2f2560]', 'childrensStories_v1ToonAnime.safetensors [2ec7b88b]', 'EimisAnimeDiffusion_V1.ckpt [4f828a15]', 'shoninsBeautiful_v10.safetensors [25d8c546]', 'epicphotogasm_xPlusPlus.safetensors [1a8f6d35]', 'mechamix_v10.safetensors [ee685731]', 'anythingv3_0-pruned.ckpt [2700c435]', 'lyriel_v16.safetensors [68fceea2]', 'rundiffusionFX25D_v10.safetensors [cd12b0ee]', 'playgroundai/playground-v2.5-1024px-aesthetic', 'stability-ai/stable-diffusion-3', 'bytedance/sdxl-lightning-4step', 'black-forest-labs/flux-schnell', 'yorickvp/llava-13b', 'meta/meta-llama-3-70b-instruct', 'google-deepmind/gemma-2b-it', 'mistralai/mixtral-8x7b-instruct-v0.1', 'upstage/solar-1-mini-chat-ja', 'upstage/solar-1-mini-chat', 'command-r', 'agent', 'dall-e', 'databricks-dbrx-instruct', 'gemini-1-5-flash', 'gemini-1-0-pro', 'gemini-1-5-pro', 'dolphin-2.5']"}
{"provider": "nexra"}
{"error":"Value nexra not in allowed values: ['AI365VIP', 'AIChatFree', 'AiChats', 'Airforce', 'Allyfy', 'Bing', 'Binjie', 'Blackbox', 'ChatGot', 'ChatGpt', 'ChatGptEs', 'ChatHub', 'Chatgpt4Online', 'Chatgpt4o', 'ChatgptFree', 'DDG', 'DeepInfraChat', 'Free2GPT', 'FreeChatgpt', 'FreeGpt', 'FreeNetfly', 'GPROChat', 'HuggingChat', 'Koala', 'Liaobots', 'LiteIcoding', 'MagickPen', 'MetaAI', 'Nexra', 'OpenaiChat', 'PerplexityLabs', 'Pi', 'Pizzagpt', 'Prodia', 'ReplicateHome', 'TeachAnything', 'Theb', 'Upstage', 'You']"}
{"provider": "Nexra"}
{"messages":[{"role": "user", "content": "what do you know about it"}]}
{"error":"500: Failed to get a response from the provider. Last tried model: gpt-4 and provider: Nexra","attempts":14}

[cly-deploy-bot]

The preview deployment is ready. 🟢

Open Preview | Open Build Logs

Last updated at: 2024-11-04 09:40:37 CET