Qwen2.5-72B-Instruct-128K

Qwen2.5-72B-Instruct-128K

Qwen/Qwen2.5-72B-Instruct-128K

About Qwen2.5-72B-Instruct-128K

Qwen2.5-72B-Instruct is one of the latest large language models series released by Alibaba Cloud. This 72B model demonstrates significant improvements in areas such as coding and mathematics. It supports a context length of up to 128K tokens. The model also offers multilingual support, covering over 29 languages, including Chinese, English, and others. It has shown notable enhancements in instruction following, understanding structured data, and generating structured outputs, particularly in JSON format.

Available Serverless

Run queries immediately, pay only for usage

$

0.59

/

$

0.59

Per 1M Tokens (input/output)

Metadata

Create on

Sep 18, 2024

License

Provider

Qwen

Specification

State

Available

Architecture

Calibrated

No

Mixture of Experts

No

Total Parameters

72

Activated Parameters

Reasoning

No

Precision

FP8

Context length

131K

Max Tokens

4K

Supported Functionality

Serverless

Supported

Serverless LoRA

Not supported

Fine-tuning

Not supported

Embeddings

Not supported

Rerankers

Not supported

Support image input

Not supported

JSON Mode

Supported

Structured Outputs

Not supported

Tools

Supported

Fim Completion

Not supported

Chat Prefix Completion

Supported

Model FAQs: Usage, Deployment

Learn how to use, fine-tune, and deploy this model with ease.

Ready to accelerate your AI development?

Ready to accelerate your AI development?