Skip to content

Migrate from V11 to V12

Remove support for streams-bootstrap v2

Support for deprecated streams-bootstrap v2 components (streams-bootstrap-v2, streams-app-v2, producer-app-v2) has been removed.

If you are still using streams-bootstrap v2, upgrade your components to supported versions of streams-bootstrap (v3+). For information on migrating your applications to newer streams-bootstrap versions, please refer to streams-bootstrap.

Component Types

Update any -v2 component types to their standard component counterparts:

pipeline.yaml

1
2
3
4
5
- - type: producer-app-v2
+ - type: producer-app

- - type: streams-app-v2
+ - type: streams-app

defaults.yaml

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
- streams-bootstrap-v2:
+ streams-bootstrap:
    ...

- producer-app-v2:
+ producer-app:
    ...

- streams-app-v2:
+ streams-app:
    ...

Custom Components

If you have custom Python components inheriting from streams-bootstrap v2 classes, update their imports and base classes:

1
2
3
4
5
6
- from kpops.components.streams_bootstrap_v2 import StreamsAppV2
+ from kpops.components.streams_bootstrap import StreamsApp

- class MyStreamsApp(StreamsAppV2):
+ class MyStreamsApp(StreamsApp):
      ...

Prefix logs with pipeline and component name

Every log line emitted while deploying, destroying, resetting or cleaning a pipeline is now prefixed with the pipeline and component it belongs to. Each component is assigned a distinct color, making it easy to follow a component's logs even when steps run concurrently with --parallel. No configuration changes are required.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
$ kpops deploy word-count --dry-run

# Before
[info     ] Picked up pipeline pipeline=word-count
[info     ]
[info     ] ########################################################################################################
[info     ] Deploy data-producer
[info     ] ########################################################################################################
[info     ]
[info     ] [Kafka REST Proxy] Topic created. topic_name=word-count-data-producer-topic
[info     ]
[info     ] ########################################################################################################
[info     ] Deploy kafka-sink-connector
[info     ] ########################################################################################################
[info     ]
[error    ] [Kafka Connect] [Errno 61] Connection refused url=http://localhost:8083/

# Now
[info     ] [word-count] Picked up pipeline
[info     ] [word-count] [data-producer] Deploy
[info     ] [word-count] [data-producer] [Kafka REST Proxy] Topic created. topic_name=word-count-data-producer-topic
[info     ] [word-count] [kafka-sink-connector] Deploy
[error    ] [word-count] [kafka-sink-connector] [Kafka Connect] [Errno 61] Connection refused url=http://localhost:8083/