1. 程式人生 > >Resize an Amazon Redshift Cluster

Resize an Amazon Redshift Cluster

Resize operation speed

To check the status of your resize operation, choose the Status tab in the Amazon Redshift console. The Status tab shows the average rate of transfer, the elapsed time, and the remaining time.

The estimated time to complete your resize operation might vary, based on the following factors:

  • The read workload on the source cluster.
  • The table definition and its skew.
  • The node type that you are scaling to and from.
  • The number of nodes in source/target configuration.
  • The amount of data that needs to be copied.
  • The read workload on the source cluster during the resize process. (Resources taken by your workload cannot be used by the resize process.)
  • The load on the source cluster or the skew of your data.

Resizing smaller node types (large, xlarge) to larger node types (8xlarge) requires more storage per node, and increased storage has more metadata that needs to be managed and written upon COMMIT. This means that the base cost for a single commit is higher for larger nodes than smaller clusters. If your workload is characterized by small commits, you might see a degradation in performance. For the best performance, group multiple changes into a single commit when possible.

Tune Amazon Redshift for performance to be sure that your tables use compression and that they are not skewed before beginning a resize operation. You can also remove unused tables to reduce resize time and disk space used on the target cluster. You can identify unused tables by using the unscanned table summary script.

Note: The unscanned table summary only reflects recent history (2-5 days).

During a resize operation, you are changing your cluster configuration to have more or fewer resources by increasing or decreasing the number of nodes. Increasing your resources can increase performance, but performance improvement depends on your workload and table design. See Amazon Redshift advanced table design for performance best practices.

Resize troubleshooting

Table size shrink or growth is expected during a resize because of how Amazon Redshift manages table storage. For more information about Redshift table size, see Why does a table in my Amazon Redshift cluster consume more disk storage space than expected?

If your cluster has a status of NONE in the CLI, the target cluster is still being provisioned and it has not yet been copied over. After your target cluster has been provisioned, the status changes to IN_PROGRESS.

If you need to cancel a resize, contact AWS Support for additional assistance. If your resize has failed, AWS Support will contact you to resolve the issue. In order for us to assist you, please be sure your contact information is up to date.

If you receive an error that states "Please choose a larger target cluster. Your current selection does not have enough capacity for your data set", your data size does not fit into the target cluster. Resize with more nodes or a different node type.

Billing for resized clusters

During the resize operation, you are billed for the clusters that are available to you. For example, during the resize, you can connect to the source cluster and therefore you are billed for this configuration. After the resize is complete, you are no longer billed for the source configuration and billing starts for the target configuration as soon as it is ACTIVE. If you use snapshots and restore to resize, you are billed at the same rate. However, when using the snapshot method, you temporarily have an additional cluster, which you will be billed for until you have cleaned up your environment.

If you have purchased reserved instances, then modified billing depends on your resized cluster configuration, reserved node types, and the number of reserved nodes being purchased. See How Reserved Nodes Work for more information.

相關推薦

Resize an Amazon Redshift Cluster

Resize operation speed To check the status of your resize operation, choose the Status tab in the Amazon Redshift console. The Statu

Forcing an Amazon EMR Cluster to Resize

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Assign a Static Private IP Address to the Master Node of an Amazon EMR Cluster

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Transfer Amazon Redshift Cluster

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Launch an Amazon EMR Cluster in a VPC Environment

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Troubleshoot Error Received when Deleting an Amazon Aurora Cluster

If you delete the reader instance first and then delete the writer instance, you are prompted to take a final snapshot. After you enter a name

How Annalect built an event log data analytics solution using Amazon Redshift

Ingesting and analyzing event log data into a data warehouse in near real-time is challenging. Data ingest must be fast and efficient. The data wa

How do I resize an image using PIL and maintain its aspect ratio?

我有一個資料夾,裡的圖檔是 96×96, 我希望在這一個資料夾下的檔案被異動時,會自動產生縮圖(64×64)到其他的資料夾下。 PIL 是 Python 下最有名的影像處理套件。 這個套件,似乎在升級改版本,把一些比較少人用的屬性或方法在新版本裡拿掉,新版本也加入了更多新的功能。一般人應該都只會使用基本

I’m an Amazon Employee. My Company Shouldn’t Sell Facial Recognition Tech to Police.

When a company puts new technologies into the world, it has a responsibility to think about the consequences. Amazon, where I work, is currently allowing p

‘Shock, Anger, Disappointment’: An Amazon Employee Speaks Out

Trevor Timm: What has Amazon’s response been internally to the letter? The company has known about employee concerns for at least a few months now.Amazon e

The Most Fun (and Useful) Things You Can Do With an Amazon Echo or Google Home

This story is for Medium members.Continue with FacebookContinue with GoogleMedium curates expert stories from leading publishers exclusively for members (w

Narrativ is helping producers monetize their digital content with Amazon Redshift

Narrativ, in their own words: Narrativ is building monetization technology for the next generation of digital content producers. Our product portf

Quickly Filter Data in Amazon Redshift Using Interleaved Sorting

My colleague Tina Adams sent a guest post to introduce another cool and powerful feature for Amazon Redshift. — Jeff; Ama

Amazon Redshift Pricing

Reserved Instances (a.k.a. Reserved Nodes) are appropriate for steady-state production workloads, and offer significant discounts over On-Deman

Using Amazon Redshift for Fast Analytical Reports

With digital data growing at an incomprehensible rate, enterprises are finding it difficult to ingest, store, and analyze the data quickly while k

Access and Download the Results from an Amazon Athena Query

When you run a query using Athena, you can access the results of your query using one of the following ways: To download the results

AWS Marketplace: Matillion ETL for Amazon Redshift

Matillion ETL for Amazon Redshift makes loading and transforming data on Redshift fast, easy, and affordable. Prices start at $1.37/hour with no c

Install SSM Agent on an Amazon EC2 Linux Instance

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Amazon Redshift Resources

If you’ve never created an Amazon Redshift cluster, you’re eligible for a two month free trial of our DC2.Large node. You get 750 hour