Skip to content

Big Data

Analytics And More
  • Home
  • Spark
  • Design Patterns
  • streaming
  • Map Reduce
  • Hive
  • Hdfs & Yarn
  • Pig
  • Oozie
  • Hbase

Analytics && More

Optimization for Using AWS Lambda to Send Messages to Amazon MSK

October, 2024 adarsh

When using AWS Lambda as a producer for Amazon MSK, it’s essential to be aware of the inherent limitations and…

Continue Reading →

Posted in: Data Analytics

Rebalancing a Kafka Cluster in AWS MSK using CLI Commands

February, 2024 adarsh

Apache Kafka is a widely used distributed streaming platform known for its fault tolerance, scalability, and performance. Amazon Managed Streaming…

Continue Reading →

Posted in: Data Analytics

Using StsAssumeRoleCredentialsProvider with Glue Schema Registry Integration in Kafka Producer

February, 2024 adarsh

In this technical blog, we’ll discuss how to use the StsAssumeRoleCredentialsProvider to produce data to an IAM topic with Glue…

Continue Reading →

Posted in: Data Analytics

Producing events and handling credentials refresh for IAM enabled aws msk cluster using aws msk IAM auth library

January, 2023 adarsh

Amazon Managed Streaming for Apache Kafka (MSK) is a fully managed service that makes it easy to build and run…

Continue Reading →

Posted in: aws, Data Analytics, Design Patterns, stream processing

spark example to replace a header delimiter

October, 2021 adarsh

This article will illustrate an example of how we can replace a delimiter in a spark dataframe. Let’s start with…

Continue Reading →

Posted in: Spark

Scala code to get a secret stored in Azure key vault from databricks

July, 2021 adarsh

In this article, we will see an example to access a secret stored in an Azure key vault from a…

Continue Reading →

Posted in: Programming

How to read write data from Azure Blob Storage with Apache Spark

May, 2021 adarsh

In this short article, we will write a program in spark scala to read write data from Azure Blob Storage…

Continue Reading →

Posted in: Spark

Post navigation

Page 1 of 33
1 2 … 33 Next →

Recent Posts

  • Optimization for Using AWS Lambda to Send Messages to Amazon MSK
  • Rebalancing a Kafka Cluster in AWS MSK using CLI Commands
  • Using StsAssumeRoleCredentialsProvider with Glue Schema Registry Integration in Kafka Producer
  • Home
  • Contact Me
  • About Me
Copyright © 2017 Time Pass Techies