Skip to main content
POST
/
completions
curl -X POST https://api.gravixlayer.com/v1/inference/completions \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer $GRAVIXLAYER_API_KEY' \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct",
    "prompt": "Hello! Tell me about AI."
  }'
{
  "data": {
    "id": "<string>",
    "object": "text.completion",
    "created": 123,
    "model": "<string>",
    "choices": [
      {
        "text": "<string>",
        "index": 123,
        "logprobs": {},
        "finish_reason": "<string>"
      }
    ]
  }
}

Authorizations

​
Authorization
string
header
required

API key authentication. Get your API key from the Gravix Layer Dashboard.

Body

application/json
​
model
string
required

Model identifier

Example:

"meta-llama/llama-3.1-8b-instruct"

​
prompt
string
required

Prompt to complete

​
temperature
number
default:1

Sampling temperature

Required range: 0 <= x <= 2
​
max_tokens
integer

Maximum tokens to generate

Required range: x >= 1
​
stream
boolean
default:false

Whether to stream the response

Response

Completion response

​
data
object
⌘I