awsdocs/amazon-kinesis-data-streams-developer-guide

The open source version of the Amazon Kinesis Data Streams docs. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

NOTICE

This repository is archived, read-only, and no longer updated. For more information, read the announcement on the AWS News Blog.

You can find up-to-date AWS technical documentation on the AWS Documentation website, where you can also submit feedback and suggestions for improvement.

amazon-kinesis-data-streams-developer-guide's Issues

can we get status response for particular Data Stream

i need particular status CREATING, ACTIVE, UPDATING, DELETING for Kinesis Data stream.

i can get list of stream using this below code:

ListStreamsRequest listStreamsRequest = new ListStreamsRequest();
listStreamsRequest.setLimit(20);
ListStreamsResult listStreamsResult = client.listStreams(listStreamsRequest);
List streamNames = listStreamsResult.getStreamNames();

Add no Kinesis Data Analytics support to "when not to use the KPL"

Currently, Kinesis Data Analytics doesn't support data generated by KPL (source: https://docs.aws.amazon.com/kinesisanalytics/latest/dev/limits.html).

Would it be appropriate to add a sentence on this to the "When Not To Use the KPL" section? https://github.com/awsdocs/amazon-kinesis-data-streams-developer-guide/blob/master/doc_source/developing-producers-with-kpl.md#when-not-to-use-the-kpl

Change wording on KPL and KCL Examples

Currently, the documentation says that the StockTrade example is using KPL and KCL when it's not. The producer examples are written with the SDK, but the consumer is written with the KCL.

System Software Requirements
The system used to run the application must have Java 7 or higher installed. To download and install the latest Java Development Kit (JDK), go to Oracle's Java SE installation site.

If you have a Java IDE, such as Eclipse, you can open the source code, edit, build, and run it.

You need the latest AWS SDK for Java version. If you are using Eclipse as your IDE, you can install the AWS Toolkit for Eclipse instead.

The consumer application requires the Kinesis Client Library (KCL) version 1.2.1 or higher, which you can obtain from GitHub at Kinesis Client Library (Java).

Megabyte clarification

A single shard can ingest up to 1 MB of data per second (including partition keys) or 1,000 records per second for writes. Similarly, if you scale your stream to 5,000 shards, the stream can ingest up to 5 GB per second or 5 million records per second. If you need more ingest capacity, you can easily scale up the number of shards in the stream using the AWS Management Console or the UpdateShardCount API.

The maximum size of the data payload of a record before base64-encoding is up to 1 MB.

Does the 1 MB above refer to 1 * 1000 * 1000 or 1 * 1024 * 1024 ?