最新资讯
stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离
多元动态
登录 注册
大模型 全球精选 · @Aamna Najmi

Amazon Bedrock 将 Claude 模型扩展至印度境内推理

原文 我的收藏

AWS 宣布 Anthropic 的 Claude Opus 5、Claude Sonnet 5 和 Claude Haiku 4.5 在印度通过 Amazon Bedrock 地理跨区域推理可用。印度地理配置文件仅在 ap-south-1 与 ap-south-2 之间路由请求,数据不存储在目的区域,采用零数据保留(ZDR)模型;计费、配额、CloudWatch 与 CloudTrail 均归属源区域。可通过控制台或 Messages、InvokeModel、Converse API 使用。

AI推荐理由 AWS 官方博客宣布 Claude Opus 5、Sonnet 5、Haiku 4.5 通过 Amazon Bedrock 在印度区域可用,采用地理跨区域推理(仅在 ap-south-1 与 ap-south-2 间路由),并说明数据不落目的区域、ZDR、计费与日志归属源区域等具体机制。属于官方产品发布,事实明确、信息密度高;但本质是区域可用性扩展,对模型能力本身无新增信息,故兴趣分中等。

72

正文

We’re excited to announce the availability of Anthropic’s Claude Opus 5, Claude Sonnet 5, and Claude Haiku 4.5 in India. The India regional endpoint is served through geographic cross-Region inference. Customers in India can now access these models on Amazon Bedrock while processing the data in the India Regions in addition to the already supported global cross-Region inference. This can be useful when customers need to meet the requirements to process data locally in a desired geography. In this post, we discuss how India geographic cross-Region inference works from the Mumbai and Hyderabad Regions on Amazon Bedrock for Anthropic Claude models. We also show how to get started from the Amazon Bedrock console and with code, using Anthropic’s Messages API, Amazon Bedrock InvokeModel API, and Converse API. India inference To help you achieve the scale of your AI applications, Amazon Bedrock offers cross-Region inference profiles, a feature you can use to distribute inference across multiple AWS Regions without having to manage capacity in each Region. The request originates from your source Region where you make the API call and is automatically routed to one of the destination Regions defined in the inference profile. The India geographic profile keeps inference within India. Requests route only between ap-south-1 and ap-south-2. Your input prompts and output results might move between those two Regions. Instead of being bound to the capacity of one Region, your requests draw on a broader pool of compute. This helps you maintain throughput and consistent performance under load, which matters most during traffic peaks. Cross-Region inference operates through the secure AWS network with end-to-end encryption for data in transit. Customer data is not stored in a destination Region when using cross-Region inference. It remains exclusively within the source Region. Amazon Bedrock uses a zero data retention (ZDR) data security model. This means that by default, Amazon Bedrock does not store model inputs or outputs. However, certain models require human review by AWS as a condition if content is flagged by automatic safety classifiers. For more details, see Data retention in the Amazon Bedrock User Guide. Billing and quota consumption are tracked against your account in the source Region, regardless of which backend Region handled the request. Amazon CloudWatch and AWS CloudTrail record log entries in the source Region only, so your monitoring stays in one place. Geographic cross-Region inference is available on the bedrock-runtime endpoint. It supports Anthropic’s Messages API and the native Amazon Bedrock InvokeModel and Converse APIs, along with Amazon Bedrock features such as Amazon Bedrock Guardrails and intelligent prompt routing. Access Claude models from the Amazon Bedrock console You can access Claude models in the text playground in the Amazon Bedrock console, which requires no coding or SDK setup. You can send prompts, adjust inference parameters, and switch between variants to get a feel for each model before you integrate the API. Open the Amazon Bedrock console in the Region that you want to use as the source. In the navigation pane, under Test, choose Playground. Choose Select model in the middle of the page. Search for Anthropic Claude Opus 5, select IN Anthropic Claude Opus 5 as the inference profile under Inference, and choose Apply. Enter a prompt and choose Run to generate a response. Figure 1: The Claude Opus 5 model selected in the Amazon Bedrock console playground Call Claude models with the Anthropic Messages API and Amazon Bedrock InvokeModel and Converse API You can access Anthropic’s Claude Opus 5, Claude Sonnet 5, or Claude Haiku 4.5 programmatically with the India geographic inference profile ID using the Anthropic Messages API on bedrock-runtime through the Anthropic SDK, or keep using the InvokeModel and Converse APIs on bedrock-runtime through the AWS Command Line Interface (AWS CLI) and AWS SDK. Prerequisites Active AWS account with Amazon Bedrock access. AWS CLI installed and configured. Python 3.8+. Boto3 installed: pip install boto3. Anthropic SDK installed: pip install anthropic. The Bedrock Token Generator for Amazon Bedrock model inference authentication installed: pip install aws_bedrock_token_generator. AWS Identity and Access Management (IAM) role or user has the necessary permissions to invoke Amazon Bedrock models using a geographic cross-Region inference profile. Here’s a quick example using the AWS SDK for Python (Boto3) with the InvokeModel API: import boto3 import json # Create a Bedrock Runtime client bedrock_runtime = boto3.client( service_name="bedrock-runtime", region_name="ap-south-1" ) # Invoke Claude Sonnet 5 response = bedrock_runtime.invoke_model( modelId="in.anthropic.claude-sonnet-5", contentType="application/json", accept="application/json", body=json.dumps({ "anthropic_version": "bedrock-2023-05-31", "max_tokens": 4096, "messages": [ { "role": "user", "content": " Can you explain the features of Amazon Bedrock? " } ] }) ) result = json.loads(response["body"].read()) print(result["content"][0]["text"]) You can also use the Amazon Bedrock Converse API for a unified multi-model experience: import boto3 # Create a Bedrock Runtime client bedrock_runtime = boto3.client( service_name="bedrock-runtime", region_name="ap-south-1" ) # Invoke Claude Opus 5 response = bedrock_runtime.converse( modelId="in.anthropic.claude-opus-5", messages=[ { "role": "user", "content": [ { "text": " Can you explain the features of Amazon Bedrock?" } ] } ], inferenceConfig={ "maxTokens": 4096 } ) if 'output' in response: blocks = response['output']['message']['content'] print('\n'.join(b.get('text', '') for b in blocks if 'text' in b)) You can also use the Anthropic Messages API using the anthropic SDK package for a streamlined experience: from anthropic import Anthropic from aws_bedrock_token_generator import provide_token token = provide_token(region="ap-south-1") client = Anthropic( base_url="https://bedrock-runtime.ap-south-1.amazonaws.com/anthropic", api_key=token, ) response = client.messages.create( model="in. anthropic.claude-haiku-4-5-20251001-v1:0", max_tokens=1024, messages=[{"role": "user", "content": "Can you explain the features of Amazon Bedrock?"}], ) print(response) You can monitor usage, performance, and costs through CloudWatch and AWS Cost Explorer to scale your applications as demand grows. Conclusion With the launch of Anthropic’s Claude Opus 5, Claude Sonnet 5, and Claude Haiku 4.5 using Amazon Bedrock with India geographic cross-Region inference, you can now build highly scalable, resilient generative AI applications while keeping inference within the country. To get started, access Anthropic’s Claude models in the Amazon Bedrock console, or call them with the API using the India geographic inference profile ID. For the most current information about model availability in each Region, see Regional availability by models in the Amazon Bedrock User Guide. About the authors Aamna Najmi Aamna is a Senior Specialist Solutions Architect for Generative AI focusing on Anthropic models and operationalizing and governing generative AI systems at scale on Amazon Bedrock. She helps ISVs solve their challenges, embrace innovation, and create new business opportunities with Amazon Bedrock. Eugenio Soltero Eugenio is a Sr. Product Marketing Manager for Amazon Bedrock at AWS. With several years of experience in generative AI, he helps customers navigate the evolving landscape of foundation models and generative AI to adopt solutions that deliver measurable value. Sofian Hamiti Sofian is a technology leader with over 12 years of experience building AI solutions, and leading high-performing teams to maximize customer outcomes. He is passionate about empowering diverse talents to drive global impact and achieve their career aspirations. Ayan Ray Ayan is a Principal Partner Solutions Architect and AI Tech Lead at AWS, serving as the Worldwide Tech Lead for Anthropic at AWS. He works at the intersection of cloud architecture and Artificial Intelligence, helping organizations adopt and scale Anthropic’s technologies on AWS.

来源报道 · 3 篇 · 以下链接均前往原始媒体

AWS Machine Learning Blog Amazon Bedrock 将 Claude 模型扩展至印度境内推理 09-30 · 原文发布
← 返回精选动态 原文

更多内容