Streaming
Apache Pulsar — cloud-native messaging a streaming
Pulsar je messaging platforma nové generace. Oddělení compute od storage, multi-tenancy a tiered storage.
Pulsar vs Kafka
Klíčový rozdíl: stateless brokery + Apache BookKeeper pro storage.
Výhody
- Multi-tenancy — nativní izolace
- Tiered storage — offload do S3
- Geo-replication — vestavěná
- Pulsar Functions — serverless processing
import pulsar, json
client = pulsar.Client('pulsar://localhost:6650')
producer = client.create_producer('persistent://t/ns/orders')
producer.send(json.dumps(order).encode())
consumer = client.subscribe('persistent://t/ns/orders',
subscription_name='proc', consumer_type=pulsar.ConsumerType.Shared)
while True:
msg = consumer.receive()
process(json.loads(msg.data()))
consumer.acknowledge(msg)
Shrnutí
Pulsar je alternativa ke Kafce pro multi-tenancy a geo-replikaci. Oddělení compute/storage = lepší škálovatelnost.