Skip to content

Big Data

Analytics And More
  • Home
  • Spark
  • Design Patterns
  • streaming
  • Map Reduce
  • Hive
  • Hdfs & Yarn
  • Pig
  • Oozie
  • Hbase

Category: Data Analytics

Producing events and handling credentials refresh for IAM enabled aws msk cluster using aws msk IAM auth library

January, 2023 adarsh

Amazon Managed Streaming for Apache Kafka (MSK) is a fully managed service that makes it easy to build and run…

Continue Reading →

Posted in: aws, Data Analytics, Design Patterns, stream processing

spark example to replace a header delimiter

October, 2021 adarsh

This article will illustrate an example of how we can replace a delimiter in a spark dataframe. Let’s start with…

Continue Reading →

Posted in: Spark

How to read write data from Azure Blob Storage with Apache Spark

May, 2021 adarsh

In this short article, we will write a program in spark scala to read write data from Azure Blob Storage…

Continue Reading →

Posted in: Spark

scala code to copy azure blob from one container to another

May, 2021 adarsh

In this short article, we will write a program in scala to copy an azure blob from one container to…

Continue Reading →

Posted in: Data Analytics

scala code to zip files in Azure blob storage on databricks notebook

April, 2021 adarsh

In this short article, we will write a program in scala to compress the files in azure blob storage on…

Continue Reading →

Posted in: Data Analytics, Spark

scala test private methods and fields with spark support

March, 2021 adarsh

In this article, we will see how we can test private methods and fields in scala with spark support. There…

Continue Reading →

Posted in: Data Analytics, Spark

Spark convert json string to dataframe

March, 2021 adarsh

In this article, we will explore how we can covert a json string into a Spark dataframe. In the below…

Continue Reading →

Posted in: Data Analytics, Spark

Post navigation

Page 1 of 26
1 2 … 26 Next →

Recent Posts

  • Producing events and handling credentials refresh for IAM enabled aws msk cluster using aws msk IAM auth library
  • spark example to replace a header delimiter
  • Scala code to get a secret stored in Azure key vault from databricks
  • Home
  • Contact Me
  • About Me
Copyright © 2017 Time Pass Techies