takatost/php-pubsub-kafka

A Kafka adapter for the php-pubsub package

1.0.4 2016-11-14 03:06 UTC

Requires

• php: >=5.6.0
• ext-rdkafka: *
• superbalist/php-pubsub: ^1.0

Requires (Dev)

• mockery/mockery: ^0.9.5
• phpunit/phpunit: ^5.5

MIT

README

A Kafka adapter for the php-pubsub package.

Installation

1. Install librdkafka c library

   $ cd /tmp
   $ mkdir librdkafka
   $ cd librdkafka
   $ git clone https://github.com/edenhill/librdkafka.git .
   $ ./configure
   $ make
   $ make install

2. Install the php-rdkafka PECL extension

   PHP5

   $ pecl install channel://pecl.php.net/rdkafka-1.0.0

   PHP7

   $ pecl install channel://pecl.php.net/rdkafka-beta

3. Add the following to your php.ini file to enable the php-rdkafka extension extension=rdkafka.so

4. composer require superbalist/php-pubsub-kafka

Usage

// create consumer
$topicConf = new \RdKafka\TopicConf();
$topicConf->set('auto.offset.reset', 'smallest');

$conf = new \RdKafka\Conf();
$conf->set('group.id', 'php-pubsub');
$conf->set('metadata.broker.list', '127.0.0.1');
$conf->set('enable.auto.commit', 'false');
$conf->set('offset.store.method', 'broker');
$conf->setDefaultTopicConf($topicConf);

$consumer = new \RdKafka\KafkaConsumer($conf);

// create producer
$producer = new \RdKafka\Producer();
$producer->addBrokers('127.0.0.1');

$adapter = new \Superbalist\PubSub\Kafka\KafkaPubSubAdapter($producer, $consumer);

// consume messages
// note: this is a blocking call
$adapter->subscribe('my_channel', function ($message) {
    var_dump($message);
});

// publish messages
$adapter->publish('my_channel', 'HELLO WORLD');
$adapter->publish('my_channel', json_encode(['hello' => 'world']));
$adapter->publish('my_channel', 1);
$adapter->publish('my_channel', false);

Examples

The library comes with examples for the adapter and a Dockerfile for running the example scripts.

Run make up.

You will start at a bash prompt in the /opt/php-pubsub directory.

If you need another shell to publish a message to a blocking consumer, you can run docker-compose run php-pubsub-kafka /bin/bash

To run the examples:

$ php examples/KafkaConsumerExample.php
$ php examples/KafkaPublishExample.php (in a separate shell)