Preparing Raspberry Pi Raspberry Pi 3B+ or Raspberry Pi 4 (4 or 8 GB model). I have used 3B+ Kinshuk Dutta New York
-
-
Error Handling and Fault Tolerance in Scala: Utilizing Try, Either, and Option Originally posted December 12, 2018 by Kinshuk Dutta Welcome back to the Scala series! In our last post, we explored concurrency with Futures and Promises. Now, we’ll delve into error handling and fault tolerance, using Try, Either, and Option in Scala. These tools allow us to handle failures gracefully and create resilient applications. In this blog, we’ll cover error handling fundamentals, illustrate usage with examples, and introduce a sample project: a File Processing System that reads, validates, and processes data from various files, handling errors at each step.…
-
Concurrency and Parallelism in Scala: Mastering Futures and Promises Originally posted December 5, 2018 by Kinshuk Dutta Welcome back to our Scala series! Now that we’ve covered type classes and implicits, we’re ready to dive into concurrency and parallelism using Futures and Promises in Scala. These tools allow us to handle asynchronous tasks gracefully and are foundational to building scalable, real-time applications in Scala. In this blog, we’ll explore concurrency basics, then dive into a sample project: a Real-Time Stock Market Notifier. This project will demonstrate how to fetch and process stock prices asynchronously, alerting users to any sudden price…
-
Originally posted November 15, 2018 by Kinshuk Dutta In this blog, we’ll explore the powerful concepts of type classes and implicits in Scala. Type classes allow us to define functionality based on the type of an argument, without modifying existing code or relying on inheritance. Implicitsenable Scala to find the right implementations at runtime, making our code more flexible and concise. Together, they’re perfect for building modular applications. To solidify these concepts, we’ll build a sample project: a Flexible Discount System for an e-commerce platform. This system uses type classes and implicits to calculate discounts based on customer type and…
-
Concurrency in Scala: Mastering Futures, Promises, and Asynchronous Programming Originally posted October 24, 2018 by Kinshuk Dutta In this installment, we’re diving into concurrency in Scala, exploring how Futures and Promises simplify asynchronous programming. These features make it easier to handle complex workflows without blocking threads, an essential skill for modern applications. This blog builds on the principles from previous posts in our Scala series and introduces a sample project: Real-Time Order Processing System. Table of Contents Introduction to Concurrency in Scala Futures and Promises in Scala Combining Futures for Complex Workflows Sample Project: Real-Time Order Processing System Project Structure…
-
Advanced Functional Programming in Scala: Pattern Matching, Case Classes, and Options Originally posted October 17, 2018 by Kinshuk Dutta In this blog, we’ll dive into advanced functional programming principles in Scala, particularly focusing on pattern matching, case classes, and functional error handling using Option and Try. To demonstrate these concepts, we’ll walk through a sample project: E-commerce Order Processing System, which showcases the use of these techniques in a real-world scenario. Table of Contents Pattern Matching in Scala Case Classes and Their Role Error Handling with Option and Try Sample Project: E-commerce Order Processing System Project Structure Implementation Guide Testing…
-
Functional Programming in Scala: Higher-Order Functions, Immutability, and Pure Functions Originally posted October 10, 2018 by Kinshuk Dutta Table of Contents Introduction to Functional Programming in Scala Higher-Order Functions Immutability in Scala Pure Functions and Side-Effect-Free Code Functional Programming in Action: Practical Examples Next Steps in Scala and Functional Programming Introduction to Functional Programming in Scala Functional programming (FP) has become a cornerstone of modern programming, especially for building reliable, maintainable, and scalable systems. Scala stands out by seamlessly integrating functional programming principles with object-oriented features, making it a perfect choice for developers who want to leverage the benefits of…
-
Simple Problem Statement Managing the following Master Data domains: PARTY Domain Patients Health care providers (HCP) Doctors (which is a subset of HCP) LOCATION Domain Health care organizations (HCO) Hospitals (which is a subset of HCO) PRODUCT Domain Drugs @ NDC Medical Devices Managing the following Reference Data domains: NUCC taxonomy NPI number Managing the following Metadata domains: Business metadata Technical metadata Managing Compliances! My Setup Hardware Server: Macbook Pro Software MDM Product: Orchestra Network’s EBX5 Database Server: Postgres SQL Detailed Capabilities & Use Cases Consolidation Use Case Match Engine Vocabulary Data Quality Check the data quality of the source…
-
Originally posted October 2, 2018 by Kinshuk Dutta Table of Contents What is Scala? Comparison Between Scala and Java Installing Scala on macOS Setting Up Your Development Environment Scala Basics with REPL Data Types, Variables, and Immutability Next Steps in Scala Learning What is Scala? Scala is a general-purpose programming language that blends object-oriented and functional programming, providing powerful support for concurrency and a strong static type system. It’s designed to be concise and expressive, particularly in comparison to Java. Scala’s compatibility with Java makes it a popular choice in Big Data applications, notably with frameworks like Apache Spark. Comparison…
-
Kafka at Scale: Advanced Security, Multi-Cluster Architectures, and Serverless Deployments Originally posted 2018-04-05 by Kinshuk Dutta (Final installment of the Kafka series) In previous blogs, we covered Kafka’s core features, advanced configurations, complex event processing, and cloud deployments. In this final post, we’ll explore advanced Kafka security measures, multi-cluster architectures, and the potential of Kafka in serverless environments. As Kafka continues to power high-throughput data streams in enterprises worldwide, understanding these advanced topics will help ensure secure, resilient, and scalable Kafka deployments. Table of Contents Advanced Kafka Security Encryption Authentication and Authorization Auditing and Compliance Multi-Cluster Kafka Setups Kafka MirrorMaker…