Distributed Message Service (Kafka)

Distributed Message Service (Kafka) is a distributed, high-throughput, and high-availability message queuing service that provides fully managed services based on open source Kafka. It solves the long-standing pain points of open source products. Users only need to focus on business development, without caring about O&M and deployment. With the features of low cost, greater elasticity and larger reliability, it is widely used in log collection, monitoring data aggregation, streaming data processing, online and offline analysis and other big data fields.  So it's an integral part of  big data  
  • Product Advantages
  • Features
  • Scenarios

Product Advantages

High Availability

Automatic load balancing of production and consumption and automatic active/standby failover when a message node fails guarantee business continuity.

High Security

Provide user authentication and SASL authorized access mechanism, provide enterprise-level security protection, and prevent data breach or tampering during transmission.

High reliability

Multiple copies of a message reside on the disk, allowing massive message accumulation.

Fully Managed

The business system is based on codes of the existing open source Apache Kafka, and can be migrated to the cloud platform without any transformation

Features
Rich messaging capabilities Support broadcast message, message backtracking, automatic message deletion, and automatic failover
High-throughput queue capacity Realize asynchronous and synchronous replication of multiple copies of messages, and feature high throughput and high reliability
Visual management interface Provide visual operation interfaces for application user management, topic management, consumer group management, Broker monitoring, and topic monitoring
Enterprise-class security Provide traceable tenant management operation records, user authentication and SASL authorized access mechanism

Scenarios

< >
  • Log collection
  • Streaming Computing and Processing
  • Multiplexing
Scenario Descriptions
  • Kafka is suitable as a "log collection center". It is non-invasive for business when log data is sent to the Kafka cluster. In addition, Kafka consumer is suitable for using with offline repository storage such as Hadoop/ODPS and Strom/Spark to implement real-time online analysis. Using this product, users only need to focus on business logic to implement system statistics, analysis and report querying without any further development.
Target function
  • Application analysis decoupling: As a bridge between application system and analysis system, it decouples applications, reducing system complexity.
  • Support online/offline analysis system: Support real-time online analysis system and offline analysis system similar to Hadoop with high efficiency and reliability.