# LAMBDA ARCHITECTURE

1\) <http://lambda-architecture.net/>

{% embed url="<http://lambda-architecture.net/>" %}

2\) <https://searchbusinessanalytics.techtarget.com/definition/Lambda-architecture>

Lambda architecture is an approach to [big data](ahttps://searchcloudcomputing.techtarget.com/definition/big-data-Big-Data) management that provides access to [batch](https://searchdatacenter.techtarget.com/definition/batch)processing and near [real-time](https://whatis.techtarget.com/definition/real-time) processing with a **hybrid approach.**&#x20;

The basic architecture of Lambda has three layers:

&#x20;                      a)  Batch

&#x20;                      b) speed

&#x20;                     c)  serving

\>The batch layer, which typically makes use of [Hadoop](https://searchdatamanagement.techtarget.com/definition/Hadoop), is the location where all the data is stored. [MapReduce](https://searchcloudcomputing.techtarget.com/definition/MapReduce) runs regular batch processing on the totality of this data. This information is sent to a [data store](https://whatis.techtarget.com/definition/data-store) and is used to gain insights into historic data trends.

\>Alongside this slower layer, new data is captured and processed as it comes in. **The speed layer** provides business users with the ability to adjust decision making and respond quickly to rapidly emerging trends. Data that passes into this real-time layer is also copied into the larger data set for slower, batch processing. Once the real-time processing is complete, the data is cleared from the speed layer to clear the way for more incoming data. The real-time layer can operate efficiently even with a steady stream of complex data because it only has to handle the volume of data that comes in between rounds of batch processing.

\>The speed and batch layers are merged together for querying through the **serving layer** which features a [massively parallel processing](https://whatis.techtarget.com/definition/MPP-massively-parallel-processing) query engine. Having access to this combined [data set](https://whatis.techtarget.com/definition/data-set)helps ensure that accurate reporting is available at all times with low [latency](https://whatis.techtarget.com/definition/latency).

![](/files/-Ld85NbI4VKszZCDy8lq)

3\) <https://medium.com/walmartlabs/how-we-built-a-data-pipeline-with-lambda-architecture-using-spark-spark-streaming-9d3b4b4555d3>

![](/files/-Ld86Lk4KvX_wSdwx5My)

4\) <https://dzone.com/articles/lambda-architecture-big-data>

![](/files/-Ld87J3L0CEj3MfqjvbT)

![](/files/-Ld87agU9ek2E1WmTmyC)

5\) <https://towardsdatascience.com/lambda-architecture-how-to-build-a-big-data-pipeline-part-1-8b56075e83fe>

Lambda Architecture Approach :&#x20;

This approach to architecture attempts to **balance latency, throughput, and fault-tolerance** by using **batch** processing to provide comprehensive and accurate views of batch data, while simultaneously using real-time stream processing to provide views of online data.

![](/files/-Ld8836P9c0eCGuifezI)

6\) <https://mapr.com/tech-briefs/stream-processing-mapr/>

![](/files/-Ld890nljFYU_zXS_bjn)

7\) <https://www.jamesserra.com/archive/2016/08/what-is-the-lambda-architecture/>

![](/files/-Ld89AvZlCNLNFRGFDXp)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://architectures.gitbook.io/project/lambda-architecture.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
