Skip to content

Migrate from V7 to V8

Add support for streams-bootstrap v3

From now on KPOps supports streams-bootstrap v3 as its default component. The previous streams-bootstrap version (below 3.x.x) is marked as deprecated and will be removed in a future version of KPOps. If you don't want to migrate your producer or streams app to v3, you should suffix your components with -v2. Here is an example of a pipeline.yaml file.

pipeline.yaml

1
2
3
4
5
6
7
- - type: producer-app
+ - type: producer-app-v2

- - type: streams-app
+ - type: streams-app-v2

# rest of your pipeline

my-components.py

1
2
3
- class MyStreamsApp(StreamsApp):
+ class MyStreamsApp(StreamsAppV2):
    ...

Info

The streams-boostrap, streams-app, and producer-app now all take the Helm values of streams-bootstrap version 3. You can find these values under the Helm charts documentation or by referring to the Base model definitions.

Rename role to label

The keyword role is renamed to label. You need to replace it in your pipeline.yaml, defaults.yaml, and the Python components definition files. Here is a simple example of the defaults.yaml.

defaults.yaml

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
streams-app-v2:
  values:
    streams:
      brokers: localhost:9092
  from:
    topics:
      my-labeled-input-topic:
-       role: my-input-topic-label
+       label: my-input-topic-label
      my-labeled-input-pattern:
        type: pattern
-       role: my-input-topic-labeled-pattern
+       label: my-input-topic-labeled-pattern

  to:
    topics:
      my-labeled-topic-output:
-       role: my-output-topic-label
+       label: my-output-topic-label

# rest of your pipeline

Make KafkaApp responsible for deploying/cleaning streams bootstrap components

The KafkaApp component now only contains the deployment logic of the stream-bootstrap applications (streams-app, producer-app). It should not be used in the defaults.yaml nor the pipeline.yaml. If you are using it, it should be replaced by streams-bootstrap.

defaults.yaml

1
2
3
4
5
6
- kafka-app:
+ streams-bootstrap-v2:
    values:
      streams:
        brokers: 127.0.0.1:9092
        schemaRegistryUrl: 127.0.0.1:8081