Posted On: Oct 28, 2022
Amazon Managed Streaming for Apache Kafka (MSK) now offers Tiered storage that brings a virtually unlimited and low-cost storage tier. Tiered Storage lets you store and process data using the same Kafka APIs and clients , while saving your storage costs by 50% or more over existing MSK storage options . Tiered Storage makes it easy and cost-effective when you need a longer safety buffer to handle unexpected processing delays or build new stream processing applications. You can now scale your compute and storage independently, simplifying operations.
You can enable Tiered Storage with a few clicks for new or existing clusters and pay only for your storage and data retrieval. You can first store data in a performance optimized primary storage tier and let MSK automatically tier data into the new low-cost tier for longer retention. The feature is supported in all commercial AWS regions where MSK is present, excluding the AWS GovCloud (US Regions). To learn how to get started with MSK and Tiered Storage, visit our Amazon MSK Developer Guide.
Amazon MSK is a fully managed service for Apache Kafka and Kafka Connect that makes it easy for you to build and run applications that use Apache Kafka as a data store. Amazon MSK is fully compatible with Apache Kafka, which enables you to quickly migrate your existing Apache Kafka workloads to Amazon MSK with confidence or build new ones from scratch. With Amazon MSK, you spend more time building innovative applications and less time managing clusters.
Oct 31, 2022: A previous version of this post incorrectly referenced GovCloud (US) Region availability. We have corrected this reference to GovCloud (US) Regions.