Llama 3.1 70B Instruct

Overview

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong... Llama 3.1 70B Instruct is served through the PARROTSIGHT unified API at Meta's list price, with the same authentication, metering and regional pinning (MY / SG / ID) as every native model. No separate provider account is required.

• 131K token context
• OpenAI-compatible endpoint — migrate with a two-line change
• Streaming (SSE) supported for all text outputs
• Billed at provider list price, metered per token

Capabilities

API

curl -X POST https://api.parrotsight.com/v1/chat/completions \
  -H "Authorization: Bearer $PS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta-llama/llama-3.1-70b-instruct","messages":[{"role":"system","content":"You are a concise bilingual assistant."},{"role":"user","content":"Summarise this quarter's platform metrics in Malay and English."}],"stream":true}'

Version history

1. v2024.7Latest2024-07-23

   Added to the PARROTSIGHT catalogue at Meta list pricing.