Skip to content

Big Data

Analytics And More
  • Home
  • Spark
  • Design Patterns
  • streaming
  • Map Reduce
  • Hive
  • Hdfs & Yarn
  • Pig
  • Oozie
  • Hbase

Category: Programming

Spark convert json string to dataframe

March, 2021 adarsh

In this article, we will explore how we can covert a json string into a Spark dataframe. In the below…

Continue Reading →

Posted in: Data Analytics, Spark

spark dataframe fuzzy string matching

January, 2021 adarsh

In this article we will implement fuzzy string matching in a spark data frame, using the Levenshtein distance algorithm. With…

Continue Reading →

Posted in: Data Analytics, Spark

spark sql consecutive sequence example

September, 2020 adarsh

In this short article, I will show how to find the consecutive sequence in spark SQL. Below is the sample…

Continue Reading →

Posted in: Spark

spark sql example to find second highest average

adarsh

In this short article, I will show how to find the second-highest average in spark SQL. Below is the sample…

Continue Reading →

Posted in: Spark

spark sql example to find max of average

adarsh

In this short article I will show how to find max of average in spark sql. Below is the sample…

Continue Reading →

Posted in: Spark

spark create dataset from scala list

adarsh

In this short article I will show how to create dataframe/dataset in spark sql. In scala we can use the…

Continue Reading →

Posted in: Spark

Pass array as UDF parameter in Spark SQL

September, 2020 adarsh 1 Comment

1. Overview In this short article I will show how to pass an array as udf parameter in spark sql.…

Continue Reading →

Posted in: Data Analytics

Post navigation

Page 2 of 33
← Previous 1 2 3 … 33 Next →

Recent Posts

  • Producing events and handling credentials refresh for IAM enabled aws msk cluster using aws msk IAM auth library
  • spark example to replace a header delimiter
  • Scala code to get a secret stored in Azure key vault from databricks
  • Home
  • Contact Me
  • About Me
Copyright © 2017 Time Pass Techies
 

Loading Comments...