pulsar

Apache Pulsar - distributed pub-sub messaging system

Github stars Tracking Chart

logo

Pulsar is a distributed pub-sub messaging platform with a very
flexible messaging model and an intuitive client API.

Learn more about Pulsar at https://pulsar.apache.org

Main features

  • Horizontally scalable (Millions of independent topics and millions
    of messages published per second)
  • Strong ordering and consistency guarantees
  • Low latency durable storage
  • Topic and queue semantics
  • Load balancer
  • Designed for being deployed as a hosted service:
    • Multi-tenant
    • Authentication
    • Authorization
    • Quotas
    • Support mixing very different workloads
    • Optional hardware isolation
  • Keeps track of consumer cursor position
  • REST API for provisioning, admin and stats
  • Geo replication
  • Transparent handling of partitioned topics
  • Transparent batching of messages

Build Pulsar

Requirements:

  • Java JDK 1.8
  • Maven 3.3.9+

Compile and install:

$ mvn install -DskipTests

Run Unit Tests:

$ mvn test

Run Individual Unit Test:

$ cd module-name (e.g: pulsar-client)
$ mvn test -Dtest=unit-test-name (e.g: ConsumerBuilderImplTest)

Start standalone Pulsar service:

$ bin/pulsar standalone

Check https://pulsar.apache.org for documentation and examples.

Setting up your IDE

Apache Pulsar is using lombok so you have to ensure your IDE setup with
required plugins.

Intellij

To configure annotation processing in IntelliJ:

  1. Open Annotation Processors Settings dialog box by going to
    Settings -> Build, Execution, Deployment -> Compiler -> Annotation Processors.

  2. Select the following buttons:

    1. "Enable annotation processing"
    2. "Obtain processors from project classpath"
    3. "Store generated sources relative to: Module content root"
  3. Set the generated source directories to be equal to the Maven directories:

    1. Set "Production sources directory:" to "target/generated-sources/annotations".
    2. Set "Test sources directory:" to "target/generated-test-sources/test-annotations".
  4. Click "OK".

  5. Install the lombok plugin in intellij.

Eclipse

Follow the instructions here
to configure your Eclipse setup.

Build Pulsar docs

Refer to the docs README.

Contact

Pulsar slack channel at https://apache-pulsar.slack.com/

You can self-register at https://apache-pulsar.herokuapp.com/

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Crypto Notice

This distribution includes cryptographic software. The country in which you currently reside may have restrictions on the import, possession, use, and/or re-export to another country, of encryption software. BEFORE using any encryption software, please check your country's laws, regulations and policies concerning the import, possession, or use, and re-export of encryption software, to see if this is permitted. See http://www.wassenaar.org/ for more information.

The U.S. Government Department of Commerce, Bureau of Industry and Security (BIS), has classified this software as Export Commodity Control Number (ECCN) 5D002.C.1, which includes information security software using or performing cryptographic functions with asymmetric algorithms. The form and manner of this Apache Software Foundation distribution makes it eligible for export under the License Exception ENC Technology Software Unrestricted (TSU) exception (see the BIS Export Administration Regulations, Section 740.13) for both object code and source code.

The following provides more details on the included cryptographic software: Pulsar uses the SSL library from Bouncy Castle written by http://www.bouncycastle.org.

Overview

Name With Ownerapache/pulsar
Primary LanguageJava
Program languageJava (Language Count: 11)
Platform
License:Apache License 2.0
Release Count234
Last Release Namev3.0.5-candidate-1 (Posted on 2024-05-14 14:49:21)
First Release Namev1.14 (Posted on )
Created At2016-06-28 07:00:03
Pushed At2024-05-14 12:02:43
Last Commit At2024-05-14 19:22:41
Stargazers Count13.8k
Watchers Count401
Fork Count3.5k
Commits Count12.6k
Has Issues Enabled
Issues Count6779
Issue Open Count1022
Pull Requests Count12864
Pull Requests Open Count327
Pull Requests Close Count2095
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private
To the top