Skip to content

Big Data

Analytics And More
  • Home
  • Map Reduce
  • Spark
  • Hive
  • Hdfs & Yarn
  • Pig
  • Oozie
  • Hbase
  • Design Patterns
  • streaming

Tag: map reduce design pattern

mapreduce custom writable example and writablecomparable example

March, 2018 adarsh Leave a comment

In the below example lets see how to create a custom Writable that can be used as a key in…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

secondary sorting in mapreduce with custom writable as key

November, 2017 adarsh Leave a comment

We can implement secondary sorting in mapreduce using the below steps 1. Make the key a composite of the natural…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

mapreduce example to get input data from external source such as mysql

June, 2017 adarsh 2d Comments

Problem to solve – Load the collector data from mysql database and process it using mapreduce framework. We have a…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

mapreduce pattern for writing data into external source to a system outside of hadoop and hdfs like mysql database

June, 2017 adarsh Leave a comment

External source output pattern writes data to a system outside of Hadoop and HDFS.With this pattern, we are able to…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

mapreduce partition pruning concept

adarsh Leave a comment

Partition pruning configures the way the framework picks input splits and drops files from being loaded into MapReduce based on…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

hadoop mapreduce example with custom inputformat,inputsplit,recordreader,outputformat and recordwriter for generating test data

June, 2017 adarsh Leave a comment

Generating data isn’t common. Typically you’ll generate a bunch of the data at once then use it over and over…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern

mapreduce replicate,reduce side join,average pattern with real world example

adarsh 9d Comments

Problem to solve : We wish to know how have the genres ranked by Average Rating, for each profession and…

Continue Reading →

Posted in: Data Analytics, Map Reduce Filed under: map reduce, map reduce design pattern, mapreduce real world example

Post navigation

Page 1 of 5
1 2 … 5 Next →

Recent Posts

  • spark sql consecutive sequence example
  • spark sql example to find second highest average
  • spark sql example to find max of average
  • Home
  • Contact Me
  • About Me
Copyright © 2017 Time Pass Techies