Skip to content

Latest commit

 

History

History
281 lines (276 loc) · 10.1 KB

COST_zh-cn.md

File metadata and controls

281 lines (276 loc) · 10.1 KB

成本预估

在运行此资产时,您需要承担亚马逊云科技各项服务的使用费用,以下数据为截至2024年7月最新发布的版本,部署至亚马逊云科技美国东部(弗吉尼亚北部)区域 (us-east-1),并构建知识库,每月运行20个工作日,每次最多消耗4096Token, 使用推理模型anthropic.claude-3-sonnet为基准的费用预估。

模式1: 全模块部署(线上召回+内置知识库)

Module Service Required price($/Mon) Note
Console Amazon CloudFront Y 0.00 Starting from December 1, 2021, the first 1 TB of data transferred to the internet each month and 10 million HTTP/HTTPS requests from all edge locations will be free.

Data Transfer < 1TB
Amazon S3 Y 0.13 Visiting the UI 10 times per workday generates a combined size of 400MB for online and offline logs. The fixed asset size of the UI is 2.1MB. A 100MB PDF, after being split, generates approximately 300MB of S3 files. Adding the fixed assets of the model, which are 20.9GB, the total S3 usage per month is approximately 21.6GB.

S3 Standard Storage: 21.6GB
PUT Request: 1000/Mon.
SELECT Request: 10000/Mon.
RETURN/SCAN Data: 1GB/Mon.
Core Amazon S3 Y 0.38
Amazon Glue Y 0.41 Glue service Type:AWS Glue ETL jobs and interactive sessions
Costage: 1 DPU per job x 0.93 hours (3350 seconds)
Amazon Sagemaker N 37.12 PDF:
SageMaker Type: SageMaker Asynchronous Inference
Instance Type: ml.g4dn.2xlarge

1 models / 1 models per endpoint = 1.00 endpoint(s)
endpoints rounded up by 1 (1.000000) = 1 endpoint(s) (rounded up)
1 endpoint(s) x 1 instances per endpoint x 1.90 hours per day x 20 day per month = 38.00 instance hours per month
38.00 hours per month x 0.94 USD per hour instance cost = 35.72 USD (monthly On-Demand cost)
10 GB per month x 0.14 USD = 1.40 USD
AWS Lambda Y 0.00 Architecture: x86_64
requests: 20000/Mon.
The Lambda free tier includes 1M free requests per month and 400,000 GB-seconds of compute time per month.
Amazon DynamoDB Y 34.92 Capacity mode: Provisioned(Read: 5 units Write: 5 units)
2.91$/Table/Mon.
Table Nums: 12
Storage: 1GB 1.2KB/item
Amazon Opensearch Y 1,013.34 Availability Zone(s): 2-AZ without standby
Instance type: r6g.2xlarge.search
Number of data nodes: 2
Cost: 976.74 USD

Storage type: EBS
EBS volume type: General Purpose (SSD) - gp3
EBS volume size (GiB): 300
Provisioned IOPS: 3000 IOPS
Provisioned Throughput (MiB/s): 250 MiB/s
Cost: 36.60 USD
Amazon Cognito Y 69.25 1,000 SAML or OIDC federation MAUs - 50 free SAML or OIDC federation MAUs per month = 950.00 billable SAML or OIDC federation
MAUsMax (950.00 billable SAML or OIDC federation MAUs, 0 minimum billable SAML or OIDC federation MAUs) = 950 total billable SAML or OIDC federation MAUs950 MAUs x 0.015 USD = 14.25 USD (SAML or OIDC federation MAUs)
SAML or OIDC federation cost (monthly): 14.25
$100 MAUs + 1,000 SAML or OIDC federation MAUs = 1,100.00 total billable MAUs1,100.00 MAUs x 1 Advanced security features option enabled = 1,100.00 Advanced security feature MAUs
Tiered price for: 1,100.00 MAUs1,100 MAUs x 0.05 USD = 55.00 USDTotal tier cost = 55.00 USD (ASF MAUs)Advanced security feature cost (monthly): 55$
55 USD + 14.25 USD = 69.25 USD
Amazon API Gateway Y 0.19 REST API: 1,000 requests per month, no caching.
WebSocket API: 1,000 connections per day, 5,000 messages per day, average message size 32 KB, average connection duration 300 seconds

Total cost: 0.19$.
AWS Step Functions Y 0.28 Workflow Number: 1000
Transition Number per workflow: 15 State
Amazon ECR Y 0.30 3GB No Cross Region
Amazon CloudWatch Y 5.00 10GB/Month
LLM Amazon Bedrock Y 8.20 LLM Model
10,000,000 input tokens / 1000 = 10,000.00 K input tokens
10,000.00 K input tokens x 0.0002 USD per K-tokens = 2.00 USD per Month for input tokens
10,000,000 output tokens / 1000 = 10,000.00 K output tokens
10,000.00 K output tokens x 0.0006 USD per K-tokens = 6.00 USD per Month for output tokens
2.00 USD + 6.00 USD = 8.00 USD per Month for Express
Total On demand Cost for Express : 8.00 USD

Embedding Model:
10,000,000 input tokens / 1000 = 10,000.00 K input tokens
10,000.00 K input tokens x 0.00002 USD per K-tokens = 0.20 USD per Month for input token
Total On demand Cost for Titan Text Embeddings V2 (monthly): 0.20 USD
Total 1169.52

模式2: 线上召回

Module Service Required price($/Mon) Note
Console Amazon CloudFront Y 0.00 Starting from December 1, 2021, the first 1 TB of data transferred to the internet each month and 10 million HTTP/HTTPS requests from all edge locations will be free.

Data Transfer < 1TB
Amazon S3 Y 0.13 Visiting the UI 10 times per workday generates a combined size of 400MB for online and offline logs. The fixed asset size of the UI is 2.1MB. A 100MB PDF, after being split, generates approximately 300MB of S3 files. Adding the fixed assets of the model, which are 20.9GB, the total S3 usage per month is approximately 21.6GB.

S3 Standard Storage: 21.6GB
PUT Request: 1000/Mon.
SELECT Request: 10000/Mon.
RETURN/SCAN Data: 1GB/Mon.
Core Amazon S3 Y 0.38
Amazon Glue Y 0.41 Glue service Type:AWS Glue ETL jobs and interactive sessions
Costage: 1 DPU per job x 0.93 hours (3350 seconds)
AWS Lambda Y 0.00 Architecture: x86_64
requests: 20000/Mon.
The Lambda free tier includes 1M free requests per month and 400,000 GB-seconds of compute time per month.
Amazon DynamoDB Y 34.92 Capacity mode: Provisioned(Read: 5 units Write: 5 units)
2.91$/Table/Mon.
Table Nums: 12
Storage: 1GB 1.2KB/item
Amazon Cognito Y 69.25 1,000 SAML or OIDC federation MAUs - 50 free SAML or OIDC federation MAUs per month = 950.00 billable SAML or OIDC federation
MAUsMax (950.00 billable SAML or OIDC federation MAUs, 0 minimum billable SAML or OIDC federation MAUs) = 950 total billable SAML or OIDC federation MAUs950 MAUs x 0.015 USD = 14.25 USD (SAML or OIDC federation MAUs)
SAML or OIDC federation cost (monthly): 14.25
$100 MAUs + 1,000 SAML or OIDC federation MAUs = 1,100.00 total billable MAUs1,100.00 MAUs x 1 Advanced security features option enabled = 1,100.00 Advanced security feature MAUs
Tiered price for: 1,100.00 MAUs1,100 MAUs x 0.05 USD = 55.00 USDTotal tier cost = 55.00 USD (ASF MAUs)Advanced security feature cost (monthly): 55$
55 USD + 14.25 USD = 69.25 USD
Amazon API Gateway Y 0.19 REST API: 1,000 requests per month, no caching.
WebSocket API: 1,000 connections per day, 5,000 messages per day, average message size 32 KB, average connection duration 300 seconds

Total cost: 0.19$.
AWS Step Functions Y 0.28 Workflow Number: 1000
Transition Number per workflow: 15 State
Amazon ECR Y 0.30 3GB No Cross Region
Amazon CloudWatch Y 5.00 10GB/Month
LLM Amazon Bedrock Y 8.20 LLM Model
10,000,000 input tokens / 1000 = 10,000.00 K input tokens
10,000.00 K input tokens x 0.0002 USD per K-tokens = 2.00 USD per Month for input tokens
10,000,000 output tokens / 1000 = 10,000.00 K output tokens
10,000.00 K output tokens x 0.0006 USD per K-tokens = 6.00 USD per Month for output tokens
2.00 USD + 6.00 USD = 8.00 USD per Month for Express
Total On demand Cost for Express : 8.00 USD

Embedding Model:
10,000,000 input tokens / 1000 = 10,000.00 K input tokens
10,000.00 K input tokens x 0.00002 USD per K-tokens = 0.20 USD per Month for input token
Total On demand Cost for Titan Text Embeddings V2 (monthly): 0.20 USD
Total 119.06