• Data Storage - OLAP

    Apache Druid Basics

    October 14, 2023 - By 

    What is Apache Druid? Apache Druid is a high-performance, real-time analytics database designed for fast and interactive queries on large datasets. It is optimized for applications that require quick, ad-hoc queries on event-driven data, such as real-time reporting, monitoring, and dashboarding. Key Features of Apache Druid Real-time Data Ingestion: Druid allows for continuous ingestion of data from various sources (e.g., Kafka, Kinesis, Hadoop) and can perform analytics in real-time as new data arrives. High Query Performance: Druid is designed to deliver sub-second query performance by combining a columnar storage format with distributed, massively parallel processing, making it ideal for high-performance,…

  • Event Streaming - Big Data - Enterprise Application Integration - iPaaS - KAFKA - Integration

    Kafka at Scale: Advanced Security, Multi-Cluster Architectures, and Serverless Deployments

    April 5, 2018 - By 

    Kafka at Scale: Advanced Security, Multi-Cluster Architectures, and Serverless Deployments Originally posted 2018-04-05 by Kinshuk Dutta (Final installment of the Kafka series) In previous blogs, we covered Kafka’s core features, advanced configurations, complex event processing, and cloud deployments. In this final post, we’ll explore advanced Kafka security measures, multi-cluster architectures, and the potential of Kafka in serverless environments. As Kafka continues to power high-throughput data streams in enterprises worldwide, understanding these advanced topics will help ensure secure, resilient, and scalable Kafka deployments. Table of Contents Advanced Kafka Security Encryption Authentication and Authorization Auditing and Compliance Multi-Cluster Kafka Setups Kafka MirrorMaker…

  • Big Data - Event Streaming - Integration - KAFKA - iPaaS - Enterprise Application Integration

    Mastering Kafka Streams: Complex Event Processing and Production Monitoring

    October 4, 2017 - By 

    (Follow-up to Kafka Cluster Monitoring and Cloud Deployment, originally posted 2016-12-10) In our previous blog, we explored the essentials of Kafka cluster management, monitoring Kafka clusters, and deploying Kafka in cloud environments. This time, we’ll go further into Kafka Streams to tackle complex event processing (CEP) and introduce best practices for monitoring Kafka deployments in production for high-performance scenarios. Kafka Streams, with its event-driven architecture, is an ideal framework for real-time CEP, while Kafka’s robust monitoring options ensure stability and performance in high-throughput environments. Table of Contents Understanding Complex Event Processing (CEP) with Kafka Streams Key Concepts in CEP Kafka…