Skip to content

Big Data

Analytics And More
  • Home
  • Spark
  • Design Patterns
  • streaming
  • Map Reduce
  • Hive
  • Hdfs & Yarn
  • Pig
  • Oozie
  • Hbase

Category: Data Analytics

spark dataframe fuzzy string matching

January, 2021 adarsh

In this article we will implement fuzzy string matching in a spark data frame, using the Levenshtein distance algorithm. With…

Continue Reading →

Posted in: Data Analytics, Spark

spark sql consecutive sequence example

September, 2020 adarsh

In this short article, I will show how to find the consecutive sequence in spark SQL. Below is the sample…

Continue Reading →

Posted in: Spark

spark sql example to find second highest average

adarsh

In this short article, I will show how to find the second-highest average in spark SQL. Below is the sample…

Continue Reading →

Posted in: Spark

spark sql example to find max of average

adarsh

In this short article I will show how to find max of average in spark sql. Below is the sample…

Continue Reading →

Posted in: Spark

spark create dataset from scala list

adarsh

In this short article I will show how to create dataframe/dataset in spark sql. In scala we can use the…

Continue Reading →

Posted in: Spark

Pass array as UDF parameter in Spark SQL

September, 2020 adarsh 1 Comment

1. Overview In this short article I will show how to pass an array as udf parameter in spark sql.…

Continue Reading →

Posted in: Data Analytics

spark couchbase read and write data

September, 2020 adarsh

1. Overview In this article I will explain how to integrate spark and couchbase with Spark Connector to read and…

Continue Reading →

Posted in: Data Analytics, Spark

Post navigation

Page 2 of 26
← Previous 1 2 3 … 26 Next →

Recent Posts

  • Producing events and handling credentials refresh for IAM enabled aws msk cluster using aws msk IAM auth library
  • spark example to replace a header delimiter
  • Scala code to get a secret stored in Azure key vault from databricks
  • Home
  • Contact Me
  • About Me
Copyright © 2017 Time Pass Techies
 

Loading Comments...