POST/chat/completions/batch

Batch Processing

Process multiple chat completion requests in a single batch for improved efficiency and cost savings.

Batch Benefits

Batch processing reduces overhead and can provide cost savings for processing multiple requests at once.

Request

Request Body

1{
2  "requests": [
3    {
4      "model": "selam-plus",
5      "messages": [
6        {"role": "user", "content": "What is AI?"}
7      ]
8    },
9    {
10      "model": "selam-plus",
11      "messages": [
12        {"role": "user", "content": "Explain machine learning"}
13      ]
14    }
15  ]
16}

Response

1{
2  "responses": [
3    {
4      "id": "chatcmpl-123",
5      "choices": [
6        {
7          "message": {
8            "role": "assistant",
9            "content": "AI stands for Artificial Intelligence..."
10          }
11        }
12      ]
13    },
14    {
15      "id": "chatcmpl-124",
16      "choices": [
17        {
18          "message": {
19            "role": "assistant",
20            "content": "Machine learning is a subset of AI..."
21          }
22        }
23      ]
24    }
25  ]
26}

Examples

1import requests
2
3response = requests.post(
4    "https://api.selamgpt.com/v1/chat/completions/batch",
5    headers={
6        "Content-Type": "application/json",
7        "Authorization": "Bearer YOUR_API_KEY"
8    },
9    json={
10        "requests": [
11            {
12                "model": "selam-plus",
13                "messages": [{"role": "user", "content": "What is AI?"}]
14            },
15            {
16                "model": "selam-plus",
17                "messages": [{"role": "user", "content": "Explain machine learning"}]
18            }
19        ]
20    }
21)
22
23results = response.json()["responses"]
24for result in results:
25    print(result["choices"][0]["message"]["content"])

Was this page helpful?