In this short article I will show how to create dataframe/dataset in spark sql. In scala we can use the…
1. Overview In this short article I will show how to pass an array as udf parameter in spark sql.…
1. Overview In this article I will explain how to integrate spark and couchbase with Spark Connector to read and…
In this article, I will illustrate how to insert/merge data in delta lake databricks. Delta Lake is an open-source storage…
In this article, I will illustrate how to integrate databricks spark in azure with apache poi and crealytics/spark-excel. Apache poi…
In this article I will illustrate how to use when clause in spark dataframe. Lets consider the below sql query…
In the Databricks notebook, the SparkSession is created for you when you start a cluster with databricks runtime . The…