Together-Ai on AI Knowledge Base

Agent Integrations

Mon, 01 Jan 0001 00:00:00 +0000

Using OSS agent frameworks with Together AI

Agent Workflows

Mon, 01 Jan 0001 00:00:00 +0000

Orchestrating together multiple language model calls to solve complex tasks.

Agno

Mon, 01 Jan 0001 00:00:00 +0000

Using Agno with Together AI

AI Evaluations UI

Mon, 01 Jan 0001 00:00:00 +0000

Guide to using the AI Evaluations UI for model assessment

API & Integrations

Mon, 01 Jan 0001 00:00:00 +0000

Manage clusters programmatically with CLI, REST API, Terraform, and third-party tools

API Keys & Authentication

Mon, 01 Jan 0001 00:00:00 +0000

Create, manage, and authenticate with Project-scoped API keys

AutoGen(AG2)

Mon, 01 Jan 0001 00:00:00 +0000

Using AutoGen(AG2) with Together AI

Batch

Mon, 01 Jan 0001 00:00:00 +0000

Process jobs asynchronously with the Batch API.

Billing & Pricing

Mon, 01 Jan 0001 00:00:00 +0000

Understand billing, pricing, and lifecycle policies for GPU Clusters

Billing Troubleshooting

Mon, 01 Jan 0001 00:00:00 +0000

Resolving payment issues, understanding charges, and managing billing problems.

Build a Phone Voice Agent with Together AI

Mon, 01 Jan 0001 00:00:00 +0000

Build a real-time phone voice agent from scratch with Twilio Media Streams, Together AI realtime STT, chat completions, realtime TTS, and local voice activity detection.

Building a RAG Workflow

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to build a RAG workflow with Together AI embedding and chat endpoints!

Building An AI Data Analyst

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use code interpreter to build an AI data analyst with E2B and Together AI.

Chat

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to query our open-source chat models.

Cluster Storage

Mon, 01 Jan 0001 00:00:00 +0000

Cluster User Management

Mon, 01 Jan 0001 00:00:00 +0000

Composio

Mon, 01 Jan 0001 00:00:00 +0000

Using Composio With Together AI

Conditional Workflow

Mon, 01 Jan 0001 00:00:00 +0000

Adapt to different tasks by conditionally navigating to various LLMs and tools.

Create Tickets In Slack

Mon, 01 Jan 0001 00:00:00 +0000

For customers who have a shared Slack channel with us

Creating and Managing Your Account

Mon, 01 Jan 0001 00:00:00 +0000

Credits

Mon, 01 Jan 0001 00:00:00 +0000

Understanding credits and billing basics on Together AI.

CrewAI

Mon, 01 Jan 0001 00:00:00 +0000

Using CrewAI with Together

Customer Ticket Portal

Mon, 01 Jan 0001 00:00:00 +0000

Data Preparation

Mon, 01 Jan 0001 00:00:00 +0000

Together Fine-tuning API accepts two data formats for training dataset files: text data and tokenized data (in the form of Parquet files). Below, you can learn about different types of those formats and the scenarios in which they can be most useful.

Dedicated Endpoints FAQs

Mon, 01 Jan 0001 00:00:00 +0000

Dedicated Inference

Mon, 01 Jan 0001 00:00:00 +0000

Deploy models on your own custom endpoints for improved reliability at scale

Dedicated Models

Mon, 01 Jan 0001 00:00:00 +0000

DeepSeek FAQs

Mon, 01 Jan 0001 00:00:00 +0000

DeepSeek R1 Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of reasoning models like DeepSeek-R1.

DeepSeek V3.1 QuickStart

Mon, 01 Jan 0001 00:00:00 +0000

How to get started with DeepSeek V3.1

Deploying a Fine-tuned Model

Mon, 01 Jan 0001 00:00:00 +0000

Once your fine-tune job completes, you should see your new model in your models dashboard.

Deploying Dedicated Endpoints

Mon, 01 Jan 0001 00:00:00 +0000

Guide to creating dedicated endpoints via the web UI.

Deployment Options Overview

Mon, 01 Jan 0001 00:00:00 +0000

Compare Together AI’s deployment options: fully-managed cloud service vs. secure VPC deployment for enterprises.

deprecated-spec

Mon, 01 Jan 0001 00:00:00 +0000

Deprecations

Mon, 01 Jan 0001 00:00:00 +0000

DSPy

Mon, 01 Jan 0001 00:00:00 +0000

Using DSPy with Together AI

Embeddings

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to get an embedding vector for a given text input.

Error Codes

Mon, 01 Jan 0001 00:00:00 +0000

An overview on error status codes, causes, and quick fix solutions

Fine Tuning FAQs

Mon, 01 Jan 0001 00:00:00 +0000

Fine-tuning BYOM

Mon, 01 Jan 0001 00:00:00 +0000

Bring Your Own Model: Fine-tune Custom Models from the Hugging Face Hub

Fine-tuning Guide

Mon, 01 Jan 0001 00:00:00 +0000

Learn the basics and best practices of fine-tuning large language models.

Function Calling

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to get LLMs to respond to queries with named functions and structured arguments.

Function Calling Fine-tuning

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to fine-tune models with function calling capabilities using Together AI.

Getting Started with Logprobs

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to return log probabilities for your output tokens & build better classifiers.

GLM-5 Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of GLM-5 for reasoning and agentic tasks.

GPU Clusters Overview

Mon, 01 Jan 0001 00:00:00 +0000

High-performance GPU clusters for training, fine-tuning, and large-scale AI workloads

Guides Homepage

Mon, 01 Jan 0001 00:00:00 +0000

Quickstarts and step-by-step guides for building with Together AI.

Health Checks and Node Repair

Mon, 01 Jan 0001 00:00:00 +0000

Proactively validate GPU node health and trigger repair actions for issues

How to build a Lovable clone with Kimi K2

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to build a full-stack Next.js app that can generate React apps with a single prompt.

How to build a real-time image generator with Flux and Together AI

Mon, 01 Jan 0001 00:00:00 +0000

How to build an AI audio transcription app with Whisper

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to build a real-time AI audio transcription app with Whisper, Next.js, and Together AI.

How To Build An AI Search Engine (OSS Perplexity Clone)

Mon, 01 Jan 0001 00:00:00 +0000

How to build an AI search engine inspired by Perplexity with Next.js and Together AI

How To Build An Interactive AI Tutor With Llama 3.1

Mon, 01 Jan 0001 00:00:00 +0000

Learn we built LlamaTutor from scratch – an open source AI tutor with 90k users.

How To Build An Open Source NotebookLM: PDF To Podcast

Mon, 01 Jan 0001 00:00:00 +0000

In this guide we will see how to create a podcast like the one below from a PDF input!

How to Build Coding Agents

Mon, 01 Jan 0001 00:00:00 +0000

How to build your own simple code editing agent from scratch in 400 lines of code!

How To Implement Contextual RAG From Anthropic

Mon, 01 Jan 0001 00:00:00 +0000

An open source line-by-line implementation and explanation of Contextual RAG from Anthropic!

How To Improve Search With Rerankers

Mon, 01 Jan 0001 00:00:00 +0000

Learn how you can improve semantic search quality with reranker models!

How to run nanochat on Instant Clusters⚡️

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to train Andrej Karpathy’s end-to-end ChatGPT clone on Together’s on-demand GPU clusters

How to use Cline with DeepSeek V3 to build faster

Mon, 01 Jan 0001 00:00:00 +0000

Use Cline (an AI coding agent) with DeepSeek V3 (a powerful open source model) to code faster.

How to use OpenCode with Together AI to build faster

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to combine OpenCode, a powerful terminal-based AI coding agent, with Together AI models like DeepSeek V3 to supercharge your development workflow.

How to use Qwen Code with Together AI for enhanced development workflow

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to configure Qwen Code, a powerful AI-powered command-line workflow tool, with Together AI models to supercharge your coding workflow with advanced code understanding and automation.

Image Generation

Mon, 01 Jan 0001 00:00:00 +0000

Generate high-quality images from text + image prompts.

Image Generation with Flux2

Mon, 01 Jan 0001 00:00:00 +0000

Deploy a Flux2 image generation model on Together’s managed GPU infrastructure using Dedicated Containers.

Inference FAQs

Mon, 01 Jan 0001 00:00:00 +0000

Inference Rate Limits

Mon, 01 Jan 0001 00:00:00 +0000

Rate limits restrict how often a user or client can access our API within a set timeframe.

Integrations

Mon, 01 Jan 0001 00:00:00 +0000

Use Together AI models through partner integrations.

Introduction

Mon, 01 Jan 0001 00:00:00 +0000

Deploy custom containers on Together’s managed GPU infrastructure with automatic scaling, job queues, and built-in observability.

Iterative Workflow

Mon, 01 Jan 0001 00:00:00 +0000

Iteratively call LLMs to optimize task performance.

Jig CLI

Mon, 01 Jan 0001 00:00:00 +0000

Build, push, and deploy containers to Together’s managed GPU infrastructure.

Kimi K2 QuickStart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of models like Kimi K2.

Kimi K2 Thinking QuickStart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of reasoning models like Kimi K2 Thinking.

Kimi K2.5 Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of Kimi’s new K2.5 model.

LangGraph

Mon, 01 Jan 0001 00:00:00 +0000

Using LangGraph with Together AI

Llama 4 Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

How to get the most out of the new Llama 4 models.

LLM Evaluations

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to run LLM-as-a-Judge evaluations

LoRA Fine-Tuning and Inference

Mon, 01 Jan 0001 00:00:00 +0000

Fine-tune and run inference for a model with LoRA adapters

Multiple API Keys

Mon, 01 Jan 0001 00:00:00 +0000

OpenAI Compatibility

Mon, 01 Jan 0001 00:00:00 +0000

Together’s API is compatible with OpenAI’s libraries, making it easy to try out our open-source models on existing applications.

OpenAI GPT-OSS Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

Get started with OpenAI’s GPT-OSS, open-source reasoning model duo.

openapi

Mon, 01 Jan 0001 00:00:00 +0000

Organizations

Mon, 01 Jan 0001 00:00:00 +0000

Overview

Mon, 01 Jan 0001 00:00:00 +0000

Welcome to Together AI’s docs! Together makes it easy to run, finetune, and train open source AI models with transparency and privacy.

Parallel Workflow

Mon, 01 Jan 0001 00:00:00 +0000

Execute multiple LLM calls in parallel and aggregate afterwards.

Payment Methods & Invoices

Mon, 01 Jan 0001 00:00:00 +0000

Managing payment cards, ACH transfers, viewing invoices, and updating billing details.

Platform Overview

Mon, 01 Jan 0001 00:00:00 +0000

Architecture, deployment lifecycle, and core concepts for Dedicated Container Inference.

Playground

Mon, 01 Jan 0001 00:00:00 +0000

Guide to using Together AI’s web playground for interactive AI model inference across chat, image, video, audio, and transcribe models.

Preference Fine-Tuning

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use preference fine-tuning on Together Fine-Tuning Platform

Pricing

Mon, 01 Jan 0001 00:00:00 +0000

Fine-tuning pricing at Together AI is based on the total number of tokens processed during your job.

Projects

Mon, 01 Jan 0001 00:00:00 +0000

Create isolated workspaces to organize resources, manage team access, and scope API keys

Prompting DeepSeek R1

Mon, 01 Jan 0001 00:00:00 +0000

Prompt engineering for DeepSeek-R1.

PydanticAI

Mon, 01 Jan 0001 00:00:00 +0000

Using PydanticAI with Together

Python Library

Mon, 01 Jan 0001 00:00:00 +0000

Python v2 SDK Migration Guide

Mon, 01 Jan 0001 00:00:00 +0000

Migrate from Together Python v1 to v2 - the new Together AI Python SDK with improved type safety and modern architecture.

Queue API

Mon, 01 Jan 0001 00:00:00 +0000

Submit, monitor, and manage asynchronous jobs for your Dedicated Container deployments.

Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

Deploy your first container in 20 minutes.

Quickstart

Mon, 01 Jan 0001 00:00:00 +0000

Get up to speed with our API in one minute.

Quickstart: Create Your First Cluster

Mon, 01 Jan 0001 00:00:00 +0000

Get started with GPU Clusters in minutes

Quickstart: Flux Kontext

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use Flux’s new in-context image generation models

Quickstart: Flux LoRA Inference

Mon, 01 Jan 0001 00:00:00 +0000

Quickstart: FLUX.2

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use FLUX.2, the next generation image model with advanced prompting capabilities

Quickstart: How to do OCR

Mon, 01 Jan 0001 00:00:00 +0000

A step by step guide on how to do OCR with Together AI’s vision models with structured outputs

Quickstart: How to Use OpenClaw with Together AI

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to pair OpenClaw, a powerful autonomous agent, with frontier OSS models on Together AI like Kimi K2.5 and GLM 4.7.

Quickstart: Next.Js

Mon, 01 Jan 0001 00:00:00 +0000

Build an app that can ask a single question or chat with an LLM using Next.js and Together AI.

Quickstart: Retrieval Augmented Generation (RAG)

Mon, 01 Jan 0001 00:00:00 +0000

How to build a RAG workflow in under 5 mins!

Quickstart: Using Hugging Face Inference With Together

Mon, 01 Jan 0001 00:00:00 +0000

This guide will walk you through how to use Together models with Hugging Face Inference.

Quickstart: Using Mastra with Together AI

Mon, 01 Jan 0001 00:00:00 +0000

This guide will walk you through how to use Together models with Mastra.

Quickstart: Using Vercel AI SDK With Together AI

Mon, 01 Jan 0001 00:00:00 +0000

This guide will walk you through how to use Together models with the Vercel AI SDK.

Quickstart: Wan 2.7 T2V

Mon, 01 Jan 0001 00:00:00 +0000

Generate videos from text prompts with optional audio input using the Wan 2.7 T2V model.

RAG Integrations

Mon, 01 Jan 0001 00:00:00 +0000

Reasoning

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use reasoning models that think step-by-step before answering.

Reasoning Fine-tuning

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to fine-tune reasoning models with chain-of-thought data using Together AI.

Reasoning Models Guide

Mon, 01 Jan 0001 00:00:00 +0000

How reasoning models like DeepSeek-R1 work.

Recommended Models

Mon, 01 Jan 0001 00:00:00 +0000

Find the right models for your use case

Rerank

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to improve the relevance of your search and RAG systems with reranking.

Roles & Permissions (RBAC)

Mon, 01 Jan 0001 00:00:00 +0000

Understand Organization and Project role-based access control (RBAC) including Admin and Member roles and what each can do across the Together platform

Sequential Workflow

Mon, 01 Jan 0001 00:00:00 +0000

Coordinating a chain of LLM calls to solve a complex task.

Serverless Models

Mon, 01 Jan 0001 00:00:00 +0000

Single Sign-On (SSO)

Mon, 01 Jan 0001 00:00:00 +0000

Slurm Configuration

Mon, 01 Jan 0001 00:00:00 +0000

Customize Slurm cluster settings to match your workload requirements

Slurm Management System

Mon, 01 Jan 0001 00:00:00 +0000

Speech-to-Text

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to transcribe and translate audio into text!

Sprocket SDK

Mon, 01 Jan 0001 00:00:00 +0000

A Python SDK for building inference workers that support both synchronous and asynchronous requests via Together’s platform.

Structured Outputs

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use JSON mode to get structured outputs from LLMs like DeepSeek V3 & Llama 3.3.

Supported Models

Mon, 01 Jan 0001 00:00:00 +0000

Supported models for Evaluations

Supported Models

Mon, 01 Jan 0001 00:00:00 +0000

A list of all the models available for fine-tuning.

tcloud

Mon, 01 Jan 0001 00:00:00 +0000

Text-to-Speech

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use the text-to-speech functionality supported by Together AI.

Together AI MCP Server

Mon, 01 Jan 0001 00:00:00 +0000

Install our MCP server in Cursor, Claude Code, or OpenCode in 1 click.

Together AI Skills

Mon, 01 Jan 0001 00:00:00 +0000

Give your AI coding agent deep knowledge of the Together AI platform with ready-made skills for inference, training, images, video, audio, and infrastructure.

Together Code Interpreter

Mon, 01 Jan 0001 00:00:00 +0000

Execute LLM-generated code seamlessly with a simple API call.

Together Code Sandbox

Mon, 01 Jan 0001 00:00:00 +0000

Level-up generative code tooling with fast, secure code sandboxes at scale

Together Cookbooks & Example Apps

Mon, 01 Jan 0001 00:00:00 +0000

Explore our vast library of open-source cookbooks & example apps

Together Mixture Of Agents (MoA)

Mon, 01 Jan 0001 00:00:00 +0000

Together's IAM Model

Mon, 01 Jan 0001 00:00:00 +0000

TypeScript Library

Mon, 01 Jan 0001 00:00:00 +0000

Upload a LoRA Adapter

Mon, 01 Jan 0001 00:00:00 +0000

Bring Your Own Adapter: Upload your own LoRA adapter and run inference on Together AI

Upload a Model

Mon, 01 Jan 0001 00:00:00 +0000

Run inference on your custom or fine-tuned models

Usage Limits & Analytics

Mon, 01 Jan 0001 00:00:00 +0000

Understanding account tiers, rate limits, model access, and cost analytics on Together AI.

Video Generation

Mon, 01 Jan 0001 00:00:00 +0000

Generate high-quality videos from text and image prompts.

Video Generation with Wan 2.1

Mon, 01 Jan 0001 00:00:00 +0000

Deploy a multi-GPU video generation model on Together’s managed GPU infrastructure using Dedicated Containers.

Vision LLMs

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to use the vision models supported by Together AI.

Vision-Language Fine-tuning

Mon, 01 Jan 0001 00:00:00 +0000

Learn how to fine-tune Vision-Language Models (VLMs) on image+text data using Together AI.