Skip to content
This repository was archived by the owner on Oct 10, 2023. It is now read-only.

Commit 32cd55a

Browse files
committed
Publishing 2019.1.1 release
1 parent 72b2601 commit 32cd55a

File tree

247 files changed

+20875
-1511
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

247 files changed

+20875
-1511
lines changed

Gemfile.lock

+10-7
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ GEM
2121
colorator (1.1.0)
2222
commonmarker (0.17.13)
2323
ruby-enum (~> 0.5)
24-
concurrent-ruby (1.0.5)
24+
concurrent-ruby (1.1.4)
2525
dnsruby (1.61.2)
2626
addressable (~> 2.5)
2727
em-websocket (0.5.1)
@@ -33,7 +33,7 @@ GEM
3333
execjs (2.7.0)
3434
faraday (0.15.2)
3535
multipart-post (>= 1.2, < 3)
36-
ffi (1.9.25)
36+
ffi (1.10.0)
3737
filesize (0.2.0)
3838
forwardable-extended (2.6.0)
3939
gemoji (3.0.0)
@@ -129,6 +129,8 @@ GEM
129129
commonmarker (~> 0.17.6)
130130
jekyll-commonmark (~> 1)
131131
rouge (~> 2)
132+
jekyll-contentblocks (1.2.0)
133+
jekyll
132134
jekyll-default-layout (0.1.4)
133135
jekyll (~> 3.0)
134136
jekyll-feed (0.10.0)
@@ -202,7 +204,7 @@ GEM
202204
jekyll-seo-tag (~> 2.0)
203205
jekyll-titles-from-headings (0.5.1)
204206
jekyll (~> 3.3)
205-
jekyll-watch (2.0.0)
207+
jekyll-watch (2.1.2)
206208
listen (~> 3.0)
207209
jemoji (0.10.1)
208210
gemoji (~> 3.0)
@@ -227,20 +229,20 @@ GEM
227229
mini_portile2 (~> 2.3.0)
228230
octokit (4.12.0)
229231
sawyer (~> 0.8.0, >= 0.5.3)
230-
pathutil (0.16.1)
232+
pathutil (0.16.2)
231233
forwardable-extended (~> 2.6)
232234
progressbar (1.10.0)
233235
public_suffix (2.0.5)
234236
rb-fsevent (0.10.3)
235-
rb-inotify (0.9.10)
236-
ffi (>= 0.5.0, < 2)
237+
rb-inotify (0.10.0)
238+
ffi (~> 1.0)
237239
rouge (2.2.1)
238240
ruby-enum (0.7.2)
239241
i18n
240242
ruby_dep (1.5.0)
241243
rubyzip (1.2.2)
242244
safe_yaml (1.0.4)
243-
sass (3.5.7)
245+
sass (3.7.3)
244246
sass-listen (~> 4.0.0)
245247
sass-listen (4.0.0)
246248
rb-fsevent (~> 0.9, >= 0.9.4)
@@ -266,6 +268,7 @@ PLATFORMS
266268
DEPENDENCIES
267269
github-pages
268270
jekyll-algolia
271+
jekyll-contentblocks
269272
jekyll-feed
270273
jekyll-gist
271274
jekyll-paginate

_2018.3.1/00-home.md

+78
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,78 @@
1+
---
2+
title: "Home"
3+
layout: splash
4+
permalink: /:collection/
5+
mastheadNavItem: Documentation
6+
collection: 2018.3.1
7+
quickLinks:
8+
- link:
9+
- title: Introduction
10+
- url: about/overview/
11+
- link:
12+
- title: What's New?
13+
- url: about/whats-new/
14+
- link:
15+
- title: Key Concepts
16+
- url: about/key-concepts/
17+
gettingStarted:
18+
- mainTitle: How to get going
19+
- link:
20+
- title: Installing IBM Event Streams
21+
- url: installing/installing/
22+
- icon: install.svg
23+
- link:
24+
- title: Migrating from Community Edition
25+
- url: installing/migrating/
26+
- icon: migrate.svg
27+
- link:
28+
- title: Getting started with Event Streams as a hosted service
29+
- url: https://cloud.ibm.com/docs/services/EventStreams?topic=eventstreams-getting_started#getting_started
30+
- icon: install.svg
31+
- link:
32+
- title: Upgrading
33+
- url: installing/upgrading/
34+
- icon: upgrade.svg
35+
- link:
36+
- title: Logging In
37+
- url: getting-started/logging-in/
38+
- icon: login.svg
39+
- link:
40+
- title: Generating a starter application
41+
- url: getting-started/generating-starter-app/
42+
- icon: generate.svg
43+
- link:
44+
- title: Testing message loads
45+
- url: getting-started/testing-loads/
46+
- icon: messageLoads.svg
47+
- link:
48+
- title: Creating client apps
49+
- url: getting-started/client/
50+
- icon: clientApps.svg
51+
commonTasks:
52+
- mainTitle: Common Tasks
53+
- link:
54+
- title: Managing access
55+
- url: security/managing-access/
56+
- icon: lock.svg
57+
- link:
58+
- title: Monitoring deployment health
59+
- url: administering/deployment-health/
60+
- icon: monitorHealth.svg
61+
- link:
62+
- title: Scaling
63+
- url: administering/scaling/
64+
- icon: scaling.svg
65+
- link:
66+
- title: Setting quotas
67+
- url: administering/quotas/
68+
- icon: quota.svg
69+
- link:
70+
- title: Replicating across geographies
71+
- url: georeplication/about/
72+
- icon: geoRep.svg
73+
- link:
74+
- title: Connecting to IBM MQ
75+
- url: connecting/mq/
76+
- icon: mqFavicon-01.svg
77+
78+
---

_docs/01-about/01-overview.md _2018.3.1/01-about/01-overview.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
---
22
title: "Introduction"
3-
permalink: /about/overview/
43
excerpt: "IBM Event Streams is an event-streaming platform based on the open-source Apache Kafka® project."
5-
4+
categories: about
5+
slug: overview
66
toc: false
77
---
88

9-
{{site.data.reuse.long_name}} is an event-streaming platform based on the open-source Apache Kafka® project. {{site.data.reuse.short_name}} release 2018.3.0 uses the Kafka 2.0 release and supports the use of all Kafka interfaces. ![Event Streams 2018.3.1 and later icon](../../images/2018.3.1.svg "Only in Event Streams 2018.3.1 and later.") {{site.data.reuse.short_name}} 2018.3.1 and later uses the Kafka 2.0.1 release.
9+
{{site.data.reuse.long_name}} is an event-streaming platform based on the open-source Apache Kafka® project. {{site.data.reuse.short_name}} release 2018.3.0 uses the Kafka 2.0 release and supports the use of all Kafka interfaces. ![Event Streams 2018.3.1](../../../images/2018.3.1.svg "In Event Streams 2018.3.1.") {{site.data.reuse.short_name}} release 2018.3.1 uses the Kafka 2.0.1 release.
1010

1111
{{site.data.reuse.long_name}} builds upon the {{site.data.reuse.icp}} platform to deploy Apache Kafka in a resilient and manageable way. It includes a UI design aimed at application developers getting started with Apache Kafka, as well as users operating a production cluster.
1212

_docs/01-about/01-whats-new.md _2018.3.1/01-about/01-whats-new.md

+5-5
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
---
22
title: "What's new"
3-
permalink: /about/whats-new/
43
excerpt: "Find out what is new in IBM Event Streams."
5-
4+
categories: about
5+
slug: whats-new
66
toc: true
77
---
88

@@ -20,7 +20,7 @@ In addition to {{site.data.reuse.icp}} 3.1.0, {{site.data.reuse.short_name}} 201
2020

2121
### Kafka version upgraded to 2.0.1
2222

23-
{{site.data.reuse.short_name}} 2018.3.1 and later uses the Kafka 2.0.1 release.
23+
{{site.data.reuse.short_name}} 2018.3.1 uses the Kafka 2.0.1 release.
2424

2525
### Kafka Connect sink connector for IBM MQ
2626

@@ -46,8 +46,8 @@ See the updated tables for the {{site.data.reuse.short_name}} [resource requirem
4646

4747
Any difference in features or behaviour between {{site.data.reuse.short_name}} releases is highlighted in the documentation using the following graphics:
4848

49-
- ![Event Streams 2018.3.1 and later icon](../../images/2018.3.1.svg "Only in Event Streams 2018.3.1 and later.") Applicable to {{site.data.reuse.long_name}} 2018.3.1 and later.
50-
- ![Event Streams 2018.3.0 only icon](../../images/2018.3.0.svg "Only in Event Streams 2018.3.0.") Applicable to {{site.data.reuse.long_name}} 2018.3.0 only.
49+
- ![Event Streams 2018.3.1 icon](../../../images/2018.3.1.svg "In Event Streams 2018.3.1.") Applicable to {{site.data.reuse.long_name}} 2018.3.1.
50+
- ![Event Streams 2018.3.0 icon](../../../images/2018.3.0.svg "In Event Streams 2018.3.0.") Applicable to {{site.data.reuse.long_name}} 2018.3.0.
5151

5252
## 2018.3.0 release
5353

_2018.3.1/01-about/02-key-concepts.md

+49
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
---
2+
title: "Key concepts"
3+
excerpt: "Read about the key concepts of the Apache Kafka technology."
4+
categories: about
5+
slug: key-concepts
6+
toc: true
7+
---
8+
9+
Apache Kafka® forms the reliable messaging core of {{site.data.reuse.long_name}}. It is a publish-subscribe messaging system designed to be fault-tolerant, providing a high-throughput and low-latency platform for handling real-time data feeds.
10+
11+
![Kafka architecture diagram.](../../../images/kafka_overview.png "Diagram that shows a Kafka architecture. A producer is feeding into a Kafka topic over 3 partitions and the messages are then being subscribed to by consumers.")
12+
13+
The following are some key Kafka concepts.
14+
15+
## Cluster
16+
Kafka runs as a cluster of one or more servers. The load is balanced across the cluster by distributing it amongst the servers.
17+
18+
## Topic
19+
A stream of messages is stored in categories called topics.
20+
21+
## Partition
22+
Each topic comprises one or more partitions. Each partition is an ordered list of messages. The messages on a partition are each given a monotonically increasing number called the offset.
23+
24+
If a topic has more than one partition, it allows data to be fed through in parallel to increase throughput by distributing the partitions across the cluster. The number of partitions also influences the balancing of workload among consumers.
25+
26+
## Message
27+
The unit of data in Kafka. Each message is represented as a record, which comprises two parts: key and value. The key is commonly used for data about the message and the value is the body of the message. Kafka uses the terms record and message interchangeably.
28+
29+
Many other messaging systems also have a way of carrying other information along with the messages. Kafka 0.11 introduced record headers for this purpose.
30+
31+
Because many tools in the Kafka ecosystem (such as connectors to other systems) use only the value and ignore the key, it’s best to put all of the message data in the value and just use the key for partitioning or log compaction. You should not rely on everything that reads from Kafka to make use of the key.
32+
33+
## Producer
34+
A process that publishes streams of messages to Kafka topics. A producer can publish to one or more topics and can optionally choose the partition that stores the data.
35+
36+
## Consumer
37+
A process that consumes messages from Kafka topics and processes the feed of messages. A consumer can consume from one or more topics or partitions.
38+
39+
## Consumer group
40+
A named group of one or more consumers that together consume the messages from a set of topics. Each consumer in the group reads messages from specific partitions that it is assigned to. Each partition is assigned to one consumer in the group only.
41+
42+
* If there are more partitions than consumers in a group, some consumers have multiple partitions.
43+
* If there are more consumers than partitions, some consumers have no partitions.
44+
45+
To learn more, see the following information:
46+
* [Producing messages](../producing-messages)
47+
* [Consuming messages](../consuming-messages)
48+
* [Partition leadership](../partition-leadership/)
49+
* [Apache Kafka documentation](http://kafka.apache.org/documentation.html)

_docs/01-about/03-producing-messages.md _2018.3.1/01-about/03-producing-messages.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
---
22
title: "Producing messages"
3-
permalink: /about/producing-messages/
43
excerpt: "A producer is an application that publishes streams of messages to Kafka
54
topics."
6-
5+
categories: about
6+
slug: producing-messages
77
toc: true
88
---
99

_docs/01-about/04-consuming-messages.md _2018.3.1/01-about/04-consuming-messages.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
---
22
title: "Consuming messages"
3-
permalink: /about/consuming-messages/
43
excerpt: "A consumer is an application that consumes streams of messages from
54
Kafka topics."
6-
5+
categories: about
6+
slug: consuming-messages
77
toc: true
88
---
99

_docs/01-about/05-partition-leadership.md _2018.3.1/01-about/05-partition-leadership.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
---
22
title: "Partition leadership"
3-
permalink: /about/partition-leadership/
43
excerpt: "Each partition has one server in the cluster that acts as the
54
partition's leader and other servers that act as the followers."
6-
5+
categories: about
6+
slug: partition-leadership
77
toc: false
88
---
99

_docs/01-about/06-accessibility.md _2018.3.1/01-about/06-accessibility.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
---
22
title: "Accessibility"
3-
permalink: /about/accessibility/
43
excerpt: "Accessibility features for IBM Event Streams."
5-
4+
categories: about
5+
slug: accessibility
66
toc: true
77
---
88
Accessibility features assist users who have a disability, such as restricted mobility or limited vision, to use information technology content successfully.

_docs/01-about/07-notices.md _2018.3.1/01-about/07-notices.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
---
22
title: "Notices"
3-
permalink: /about/notices/
43
excerpt: "Legal notices for IBM Event Streams."
5-
4+
categories: about
5+
slug: notices
66
toc: true
77
---
88

_docs/02-installing/00-trying-out.md _2018.3.1/02-installing/00-trying-out.md

+2-1
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Trying out Event Streams"
3-
permalink: /installing/trying-out/
43
excerpt: "Install a basic deployment to try out IBM Event Streams."
4+
categories: installing
5+
slug: trying-out
56
toc: false
67
---
78

_docs/02-installing/01-prereqs.md _2018.3.1/02-installing/01-prereqs.md

+14-15
Original file line numberDiff line numberDiff line change
@@ -1,34 +1,33 @@
11
---
22
title: "Pre-requisites"
3-
permalink: /installing/prerequisites/
43
excerpt: "Pre-requisites for installing IBM Event Streams."
5-
4+
categories: installing
5+
slug: prerequisites
66
toc: true
77
---
88

99
Ensure your environment meets the following prerequisites before installing {{site.data.reuse.long_name}}.
1010

1111
## {{site.data.reuse.icp}} environment
1212

13-
{{site.data.reuse.short_name}} version | {{site.data.reuse.icp}} versions supported | Platforms supported
13+
{{site.data.reuse.short_name}} version | Container platform | Systems
1414
----------------------|--------------------|-----------------------|-------------|--------------------
15-
![Event Streams 2019.1.1 and later icon](../../images/2019.1.1.svg "Event Streams 2019.1.1.") <br/>**Note:** {{site.data.reuse.long_name}} 2019.1.1 is planned to be released on 29 March 2019. | 3.1.2 | - Linux® 64-bit (x86_64) systems <br/>- Linux on IBM® Z systems <br/>- Red Hat OpenShift Container Platform version 3.9 and 3.10
16-
| 3.1.1 | Linux® 64-bit (x86_64) systems <br/> Linux on IBM® Z systems
17-
![Event Streams 2018.3.1 icon](../../images/2018.3.1.svg "Event Streams 2018.3.1.") | 3.1.2 | - Linux® 64-bit (x86_64) systems <br/>- Linux on IBM® Z systems
18-
| 3.1.1 | - Linux® 64-bit (x86_64) systems <br/>- Linux on IBM® Z systems
19-
| 3.1.0 | Linux® 64-bit (x86_64) systems
20-
![Event Streams 2018.3.0 icon](../../images/2018.3.0.svg "Event Streams 2018.3.0.") | 3.1.0 | Linux® 64-bit (x86_64) systems
15+
![Event Streams 2018.3.1 icon](../../../images/2018.3.1.svg "Event Streams 2018.3.1.") | {{site.data.reuse.icp}} 3.1.1 and 3.1.2 | - Linux® 64-bit (x86_64) systems <br/>- Linux on IBM® Z systems
16+
| {{site.data.reuse.icp}} 3.1.0 | - Linux® 64-bit (x86_64) systems
17+
![Event Streams 2018.3.0 icon](../../../images/2018.3.0.svg "Event Streams 2018.3.0.") | {{site.data.reuse.icp}} 3.1.0 | - Linux® 64-bit (x86_64) systems
2118

19+
![Event Streams 2018.3.1 icon](../../../images/2018.3.1.svg "Event Streams 2018.3.1.") has Helm chart version 1.1.0 and includes Kafka version 2.0.1.
2220

23-
For an overview of supported component and platform versions, see the [support matrix](../../support/#support-matrix).
21+
![Event Streams 2018.3.0 icon](../../../images/2018.3.0.svg "Event Streams 2018.3.0.") has Helm chart version 1.0.0 and includes Kafka version 2.0.
2422

23+
For an overview of supported component and platform versions, see the [support matrix](../../../support/#support-matrix).
2524

2625
Ensure you have the following set up for your {{site.data.reuse.icp}} environment:
2726
* Install [{{site.data.reuse.icp}}](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/installing/install.html). \\
28-
**Note:** {{site.data.reuse.long_name}} includes entitlement to {{site.data.reuse.icp_foundation}} which you can [download](../downloading) from IBM Passport Advantage.
27+
**Note:** {{site.data.reuse.long_name}} includes entitlement to {{site.data.reuse.icp_foundation}} which you can download from IBM Passport Advantage.
2928
* Install the [Kubernetes command line tool](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/manage_cluster/cfc_cli.html), and configure access to your cluster.
30-
* Install the [{{site.data.reuse.icp}} Command Line Interface (CLI)](https://www.ibm.com/support/knowledgecenter/en/SSBS6K_3.1.1/manage_cluster/install_cli.html).
31-
* Install the [Helm CLI](https://www.ibm.com/support/knowledgecenter/en/SSBS6K_3.1.1/app_center/create_helm_cli.html) required for your version of {{site.data.reuse.icp}}, and add the {{site.data.reuse.icp}} [internal Helm repository](https://www.ibm.com/support/knowledgecenter/en/SSBS6K_3.1.1/app_center/add_int_helm_repo_to_cli.html) called `local-charts` to the Helm CLI as an external repository.
29+
* Install the [{{site.data.reuse.icp}} Command Line Interface (CLI)](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/manage_cluster/install_cli.html).
30+
* Install the [Helm CLI](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/app_center/create_helm_cli.html) required for your version of {{site.data.reuse.icp}}, and add the {{site.data.reuse.icp}} [internal Helm repository](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/app_center/add_int_helm_repo_to_cli.html) called `local-charts` to the Helm CLI as an external repository.
3231
* For message indexing capabilities (enabled by default), ensure you set the `vm.max_map_count` property to at least `262144` on all {{site.data.reuse.icp}} nodes in your cluster (not only the master node). Run the following commands on each node: \\
3332
`sudo sysctl -w vm.max_map_count=262144`\\
3433
`echo "vm.max_map_count=262144" | tee -a /etc/sysctl.conf`\\
@@ -133,9 +132,9 @@ The CPU and memory limits for some components are not limited by the chart, so t
133132

134133
## PodSecurityPolicy requirements
135134

136-
To install the {{site.data.reuse.short_name}} chart, you must have the `ibm-restricted-psp` PodSecurityPolicy selected for the target namespace.
135+
To install the {{site.data.reuse.short_name}} chart, you must have the `ibm-restricted-psp` [PodSecurityPolicy](https://ibm.biz/cpkspec-psp) selected for the target namespace.
137136

138-
You can define the PodSecurityPolicy when creating the [namespace](../planning/#namespaces) for your installation.
137+
You can define the PodSecurityPolicy when creating the [namespace](../installing/#create-a-namespace) for your installation.
139138

140139
For more information about PodSecurityPolicy definitions, see the [{{site.data.reuse.icp}} documentation](https://www.ibm.com/support/knowledgecenter/SSBS6K_3.1.1/manage_cluster/security.html).
141140

0 commit comments

Comments
 (0)