Llama 3.1 8B Instruct

Overview

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to... Llama 3.1 8B Instruct is served through the PARROTSIGHT unified API at Meta's list price, with the same authentication, metering and regional pinning (MY / SG / ID) as every native model. No separate provider account is required.

• 131K token context
• OpenAI-compatible endpoint — migrate with a two-line change
• Streaming (SSE) supported for all text outputs
• Billed at provider list price, metered per token

Capabilities

API

curl -X POST https://api.parrotsight.com/v1/chat/completions \
  -H "Authorization: Bearer $PS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta-llama/llama-3.1-8b-instruct","messages":[{"role":"system","content":"You are a concise bilingual assistant."},{"role":"user","content":"Summarise this quarter's platform metrics in Malay and English."}],"stream":true}'

Version history

1. v2024.7Latest2024-07-23

   Added to the PARROTSIGHT catalogue at Meta list pricing.