Tuesday, September 17, 2019

Lambda Architecture for Big Data Application


There are three layers involved in Lambda Architecture

  1. Batch Layer
  2. Speed Layer
  3. Servicing Layer
Lambda Architecture :

The Lambda Architecture is an accommodation of  Batch Layer & Speed Layer, where data goes to both the layers redundantly to get processed. The combination of both layers is called Lambda Architecture.
  • Batch Layer       : Where data come for batch processing.
  • Speed Layer       : Where data come for real time processing.
  • Servicing Layer : Where data is stored after processing.
First data come at data center and then go to both layers. 

At Batch layer where data is processed and stored at servicing layer in some form of NoSQL/Hadoop.
At Speed Layer, the data is processed in real time for different function/application


Use of Lambda Architecture :

This model is used where we need to show the real time data at real time application as well as in parallel we need to store the data for further analysis on historical data for any BI analysis application.





No comments:

Post a Comment