Meta tags:
description=Learn about the basics of using Apache Pulsar;

Headings (most frequently used words):

china, cloud, yahoo, case, studies, appen, iterable, cisco, getui, nutanix, huawei, keytop, flipkart, belvedere, trading, instructure, attentive, japan, cogito, corp, sina, weibo, mobile, qraft, wechat, emq, su, ning, intuit, vivo, discord, tencent, splunk, softtech, thg, narvar, overstock, bigo, ovhcloud, ntt, software, innovation, center, clever, proxyclick, newland, ksyun, netdata, zhaopin, bestpay, orange, finance, edge, by, ascential, one, click, retail, tuya, turtlequeue, vivy, dada, group, verizon, media, pandio, micro, focus,

Text of the page (most frequently used words):
and (82), pulsar (80), the (67), apache (38), for (29), data (21), with (17), its (17), our (15), messaging (14), platform (12), real (12), time (12), has (10), cloud (9), use (9), scale (8), that (8), system (8), foundation (7), are (7), streaming (7), built (7), like (7), software (6), operational (6), features (6), architecture (6), message (6), performance (6), some (6), kafka (6), iot (6), services (5), flexibility (5), from (5), which (5), can (5), messages (5), processing (5), multiple (5), systems (5), solution (5), cases (5), service (5), functions (5), their (5), after (5), scalability (5), management (4), across (4), latency (4), various (4), supports (4), most (4), provide (4), choice (4), reliability (4), topic (4), process (4), multi (4), using (4), kop (4), support (4), critical (4), throughput (4), vivo (4), adopted (4), distributed (3), large (3), applications (3), tools (3), yahoo (3), reliable (3), more (3), topics (3), proxy (3), great (3), found (3), client (3), queue (3), tuya (3), because (3), stream (3), able (3), replace (3), one (3), kubernetes (3), netdata (3), every (3), day (3), geo (3), replication (3), other (3), consistency (3), backbone (3), center (3), different (3), them (3), when (3), they (3), started (3), learn (3), component (3), based (3), such (3), discord (3), requirements (3), high (3), feature (3), china (3), year (3), keytop (3), cisco (3), case (3), studies (3), all (2), trademarks (2), license (2), open (2), source (2), events (2), environments (2), complex (2), these (2), needs (2), create (2), deployed (2), then (2), easy (2), your (2), hundreds (2), low (2), than (2), million (2), provides (2), solutions (2), media (2), really (2), development (2), point (2), view (2), well (2), less (2), load (2), upon (2), turtlequeue (2), top (2), cursor (2), next (2), handling (2), made (2), efficient (2), unique (2), been (2), click (2), retail (2), engine (2), control (2), consumers (2), very (2), through (2), own (2), query (2), monitoring (2), many (2), partitions (2), millions (2), layer (2), without (2), also (2), design (2), enough (2), ntt (2), innovation (2), ran (2), tests (2), subscription (2), model (2), this (2), decided (2), build (2), bigo (2), massive (2), challenges (2), key (2), helped (2), achieve (2), useful (2), search (2), narvar (2), business (2), softtech (2), event (2), while (2), maintaining (2), slas (2), serverless (2), tencent (2), game (2), big (2), volume (2), requires (2), task (2), machine (2), learning (2), scalable (2), comparing (2), fault (2), tolerance (2), into (2), better (2), intuit (2), building (2), helps (2), uses (2), store (2), queuing (2), manage (2), mobile (2), cluster (2), tenant (2), sina (2), weibo (2), native (2), metadata (2), new (2), cogito (2), attentive (2), marketing (2), meet (2), instructure (2), flipkart (2), etc (2), offers (2), isolation (2), around (2), centers (2), huawei (2), among (2), nutanix (2), iterable (2), here (2), contribute (2), community (2), copyright, 2026, rights, reserved, feather, logo, registered, available, under, version, contact, privacy, security, sponsorship, thanks, modern, application, increasingly, transitioning, managed, resources, generate, tremendous, observed, consumed, analyzed, later, insights, drive, actions, decisions, micro, focus, first, instance, 2015, rapidly, grown, since, today, runs, makes, increase, capacity, nodes, change, enables, you, little, 5ms, publishing, pandio, tls, only, sni, leverage, enterprise, verizon, attracted, attention, excellent, dada, group, alternative, liked, nice, separate, bookies, zookeeper, vivy, builds, same, improves, exposes, advances, consume, position, changed, something, else, beginning, settled, proved, adept, accumulation, repeated, consumption, addition, much, resulting, lower, maintenance, costs, combination, works, seamlessly, environment, edge, ascential, together, unified, computing, spark, boost, efficiency, risk, decision, deployment, thus, merchants, safe, convenient, bestpay, orange, finance, happy, zhaopin, heart, almost, coming, going, agents, passes, infinite, number, given, needed, single, agent, currently, log, businesses, processes, tens, terabytes, merge, easily, ksyun, segment, centric, pulsarsql, logic, deploying, newland, gives, allows, replay, powerful, tool, proxyclick, developed, clever, flexible, already, good, implemented, further, improve, allowed, 100k, scenario, shift, product, called, iostream, ovhcloud, team, themselves, overwhelmed, amounts, believed, could, reduce, hardware, cost, combining, ignite, lookup, enrichment, overstock, pub, sub, core, making, maintainability, quickly, tested, simple, validate, example, scenarios, effort, thg, consent, average, 500, per, guarantees, durability, strict, furthermore, integrates, lambda, style, framework, write, natively, immediately, arrival, approach, ideal, lightweight, tasks, filtering, routing, transformations, splunk, nearly, years, daily, transmission, reach, trillion, quality, assurance, index, analysis, personalized, recommendation, encountered, enhancing, live, tackle, safety, personalization, concerns, restricting, spam, access, safeguarding, users, accounts, potential, breaches, current, setup, was, designed, heuristics, not, necessity, prompted, consider, incorporating, flink, iceberg, began, explored, balancing, put, summarized, practices, bundle, created, customized, metrics, observability, generation, adapted, specific, scratch, integration, goal, site, availability, ning, actorcloud, leverages, handle, faster, analyzes, sql, exposed, upper, emq, exploration, capable, traffic, maintain, evaluating, popular, were, confident, would, best, attractive, following, wechat, choose, ability, transactions, within, microservice, now, plays, essential, part, helping, powered, order, execution, find, optimal, strategy, qraft, practice, experience, will, shared, optimization, function, improvement, selected, due, clients, achieved, introducing, handler, audio, analytic, results, utilizes, vital, deduplication, corp, tenancy, capability, indeed, played, important, role, 100, areas, commerce, advertising, japan, leading, brands, relies, ensuring, delivery, billions, exceptional, types, mutual, exclusivity, enabled, infrastructure, rehaul, researched, advocated, integrated, established, leveraging, exchange, market, belvedere, trading, there, batch, pipelines, ordered, auditing, kinds, mechanisms, peering, groups, produce, dispatch, quotas, identified, offering, take, away, complexity, teams, help, enforce, stricter, uptime, therefore, approached, backend, redesigned, securely, mission, capabilities, what, server, side, structured, have, asynchronous, communication, microservices, beam, app, over, production, priority, push, notification, getui, world, largest, platforms, numerous, spread, continents, hosting, thousands, devices, including, connected, cars, wireless, phones, underwent, two, transforming, gitops, where, replaced, legacy, clusters, provided, right, balance, rabbitmq, ultimately, amazon, sqs, serving, collection, annotation, faced, distribution, anti, scamming, training, nosql, database, resolve, those, pain, points, keep, appen, apparel, manufacturing, transportation, logistics, telecom, healthcare, financial, industries, missing, any, organizations, globe, rely, demanding, download, presentations, articles, books, blog, issue, tracking, wiki, contribution, guide, governance, discussions, welcome, docs, libraries, ecosystem, quickstart, concepts, get, skip, main, content,

Text of the page (random words):
case studies apache pulsar skip to main content apache pulsar 5 0 0 m1 is here get started concepts quickstart ecosystem client libraries docs features use cases community welcome discussions governance meet the community contribute contribution guide wiki issue tracking learn blog books case studies articles presentations events download search case studies organizations around the globe rely on apache pulsar to manage their most demanding real time requirements are we missing any click here to contribute all industries financial services healthcare marketing software it telecom retail transportation logistics apparel manufacturing appen china when serving a large volume of data collection and annotation we faced some challenges on task distribution anti scamming and ai model training we adopted the apache pulsar and nosql database solution to resolve those pain points and keep the flexibility iterable pulsar provided the right balance of scalability reliability and features to replace rabbitmq at iterable and ultimately to replace other messaging systems like kafka and amazon sqs cisco cisco iot control center is among the world s largest iot platforms with numerous data centers spread across continents hosting thousands of applications for the management of hundreds of millions of iot devices including connected cars and wireless phones cisco underwent a two year process of transforming their platform into a cloud native gitops platform where pulsar replaced legacy message queue services and is deployed across multiple kubernetes clusters getui we adopted pulsar for the new priority based push notification solution nutanix apache pulsar offers server as well as client side support for the structured streaming we have been using pulsar for asynchronous communication among microservices in our nutanix beam app for over an year in production huawei cloud huawei cloud iot requires a reliable messaging platform after comparing the capabilities and features of multiple messaging systems the design of apache pulsar is what made it our choice keytop keytop redesigned its messaging system by using apache pulsar as the backbone of its architecture its geo replication feature helps keytop securely store mission critical data across multiple data centers flipkart at flipkart there are multiple use cases for high throughput messaging like streaming batch pipelines ordered processing auditing etc pulsar offers different kinds of isolation mechanisms cluster peering isolation groups produce dispatch quotas etc we identified that offering topic as a service can take away operational complexity for these teams and help us enforce stricter slas around uptime and geo replication therefore we approached building a scalable and multi tenant platform with pulsar as the choice of backend belvedere trading leveraging pulsar to stream exchange market data to the cloud instructure we researched advocated built integrated and established apache pulsar at instructure in less than a year attentive attentive the ai marketing platform for leading brands relies on apache pulsar as the backbone of its messaging system ensuring the delivery of billions of messages with exceptional reliability and scale pulsar s built in subscription types helped provide mutual exclusivity at scale while maintaining high throughput and fault tolerance and enabled us to meet critical business requirements without a massive infrastructure rehaul yahoo japan we adopted pulsar because of its great performance scalability and multi tenancy capability indeed pulsar has played an important role to provide our 100 services in various areas such as e commerce media advertising and more cogito corp cogito uses pulsar for streaming real time audio and analytic results and utilizes the vital deduplication feature sina weibo sina weibo selected apache pulsar and kop kafka on pulsar due to pulsar s great scalability and kop s native support for kafka clients it also achieved better metadata consistency by introducing a new component metadata event handler in kop china mobile china mobile s practice and experience in pulsar will be shared such as pulsar s kubernetes cluster optimization and tenant function improvement qraft we choose pulsar for its ability to manage distributed transactions within a microservice architecture and its feature flexibility pulsar now plays an essential part in helping our ai powered order execution system to find the optimal strategy in real time wechat we started our exploration of apache pulsar when we decided to build a message queuing system that is capable of handling large scale traffic and is easy to use and maintain after evaluating some of the most popular messaging tools we were confident that pulsar would be the best choice for our message queuing platform pulsar s most attractive features to us are the following emq actorcloud uses apache pulsar to store and process streaming data leverages apache pulsar functions to handle data faster and analyzes iot data through the sql engine exposed to the upper layer su ning building apache pulsar from scratch on top of the kafka integration platform helps to achieve the goal of multi site high availability intuit we adopted pulsar for our next generation platform and adapted it for intuit specific requirements vivo after comparing different streaming and messaging tools vivo began to learn apache pulsar and explored its features in scalability fault tolerance and load balancing as vivo put apache pulsar into use it summarized some useful practices in bundle and data management vivo built its monitoring architecture based on pulsar and created its customized pulsar metrics for better observability discord discord encountered the task of enhancing its live streaming machine learning platform to tackle safety and personalization concerns like restricting spam access or safeguarding discord users accounts from potential breaches the current setup was designed for heuristics not for machine learning the necessity for a reliable scalable and real time solution prompted them to consider incorporating apache flink pulsar and iceberg tencent after nearly 10 years of development of tencent game big data the daily data transmission volume can reach 1 7 trillion as the key component of the big data platform the mq system is critical to provide real time service operational quality assurance which requires the support of various applications such as real time game operational service real time index data analysis and real time personalized recommendation splunk pulsar guarantees data consistency and durability while maintaining strict slas for throughput and latency furthermore apache pulsar integrates pulsar functions a lambda style framework to write serverless functions to natively process data immediately upon arrival this serverless stream processing approach is ideal for lightweight processing tasks like filtering data routing and transformations softtech softtech built an event based consent management system with an average throughput of 500 million messages per day on pulsar thg we quickly tested pulsar and found it simple enough to validate some example scenarios in a day of effort narvar narvar s platform is built with pub sub messaging at its core making reliability scalability maintainability and flexibility business critical overstock by combining apache pulsar functions with apache ignite we achieve low latency lookup performance for real time enrichment of data which is useful for search and other real time use cases bigo the messaging team at bigo found themselves overwhelmed by the massive amounts of data when using kafka they then started to learn apache pulsar and ran some tests with it after which they believed pulsar could be a solution to their challenges they use pulsar as a key component in their real time messaging architecture which has helped them reduce the hardware cost by 50 ovhcloud we decided to shift and build the foundation of our topic as a service product called iostream on apache pulsar ntt software innovation center pulsar has a flexible design and its performance is already good enough for many use cases the ntt software innovation center ran different performance tests and implemented its own subscription model in pulsar to further improve its performance this has allowed them to use one pulsar topic to support 100k consumers in their iot scenario clever cloud we re using apache pulsar as the foundation for our cloud backbone and developed kop kafka on pulsar proxyclick it gives us consistency with the messages in the queue it also allows us to replay messages and it s a very powerful tool for the distributed systems that like us newland apache pulsar has multi layer and segment centric architecture and supports geo replication we can query data with pulsarsql and create complex processing logic without deploying other systems with pulsar functions ksyun currently our service supports log query and monitoring for many businesses and processes tens of terabytes of data every day with pulsar we can scale up partitions and merge partitions easily and process millions of topics netdata the heart of netdata cloud is pulsar almost every message coming from and going to the open source agents passes through pulsar pulsar s infinite number of topics has given us the flexibility we needed and in some cases every single netdata agent has its own unique pulsar topic zhaopin we are very happy with our choice of pulsar and the performance and reliability it provides bestpay orange finance together with a unified computing engine like spark apache pulsar is able to boost the efficiency of our risk control decision deployment thus we are able to provide merchants and consumers with safe convenient and efficient services edge by ascential one click retail because of pulsar s unique combination of messaging and stream processing we ve been able to replace multiple systems with one solution that works seamlessly in our kubernetes environment tuya tuya settled on apache pulsar because it proved to be the most adept at handling the accumulation of messages and repeated consumption the addition of pulsar has made tuya s message system much more efficient resulting in lower operational and maintenance costs turtlequeue apache pulsar upon which turtlequeue is built builds on top of the same foundation and improves on it it exposes a cursor that advances to consume the next message the cursor s position can be changed to something else like the beginning of the queue vivy we found pulsar an alternative we really liked from the development point of view the client is really nice as well as from the operational point of view it supports separate bookies and less load on zookeeper dada group apache pulsar has attracted our attention with its excellent features and great architecture verizon media apache pulsar provides various solutions for tls proxy and pulsar is the only messaging system that supports sni proxy to leverage various enterprise proxy solutions pandio pulsar s flexibility makes it easy to scale and increase your capacity across hundreds of nodes as your needs change reliable low latency pulsar enables you to scale to more than a million topics with little latency 5ms for publishing yahoo we deployed our first pulsar instance in q2 2015 pulsar use has rapidly grown since then and as of today yahoo runs pulsar at scale micro focus modern it and application environments are increasingly complex transitioning to cloud and large in scale the managed resources services and applications in these environments generate tremendous data that needs to be observed consumed and analyzed in real time or later by management tools to create insights and to drive operational actions and decisions foundation events license thanks sponsorship security privacy contact the apache software foundation apache pulsar is available under the apache license version 2 0 apache pulsar is an open source distributed messaging and streaming platform built for the cloud copyright 2026 the apache software foundation all rights reserved apache pulsar apache pulsar and the apache feather logo are trademarks or registered trademarks of the apache software foundation