Details for this torrent 

System Design for Big Data Pipelines
Type:
Other > Other
Files:
181
Size:
1.84 GiB (1974116723 Bytes)
Uploaded:
2023-05-07 15:09:51 GMT
By:
tuts756 Trusted
Seeders:
4
Leechers:
0
Comments
0  

Info Hash:
92D30143A7D454A29B5B73993E1C60F9275FE461




(Problems with magnets links are fixed by upgrading your torrent client!)
Description

Big data technologies have been growing exponentially over the past few years and have penetrated into every domain and industry in software development. It has become a core skill for a software engineer. Robust and effective big data pipelines are needed to support the growing volume of data and applications in the big data world. These pipelines have become business critical and help increase revenues and reduce cost.

Do quality big data pipelines happen by magic? High quality designs that are scalable, reliable and cost effective are needed to build and maintain these pipelines.

How do you build an end-to-end big data pipeline that leverages big data technologies and practices effectively to solve business problems? How do you integrate them in a scalable and reliable manner? How do you deploy, secure and operate them? How do you look at the overall forest and not just the individual trees? This course focuses on this skill gap.

What are the topics covered in this course?

We start off by discussing the building blocks of big data pipelines, their functions and challenges.

We introduce a structured design process for building big data pipelines.

We then discuss individual building blocks, focusing on the design patterns available, their advantages, shortcomings, use cases and available technologies.

We recommend several best practices across the course.

We finally implement two use cases for illustration on how to apply the learnings in the course to a real world problem. One is a batch use case and another is a real time use case.
Who this course is for:

    Big Data Pipeline Designers & Architects
    Big Data Developers looking to move into Design/Architecture roles
    Software Architects looking to gain Big Data Experience

Requirements

    Big Data Technology Concepts
    Familiarity with Big Data Technologies like Apache Spark, Apache Kafka and NoSQL
    Development / Deployment Experience with Big Data Technologies and Pipelines
    Software Design and Development Experience including Cloud & Microservices

Last Updated 4/2023

[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/77 - Create CJA Skeleton Design.mp447.04 MiB
TutsNode.net.txt63 B
[TGx]Downloaded from torrentgalaxy.to .txt585 B
.pad/0473.06 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/76 - Study CJA Pipeline Flowchart.mp442.96 MiB
.pad/144.07 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/22 - Batch vs Realtime Pipelines.mp440.05 MiB
.pad/2461.9 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/39 - Batch Processing Design Practices Part 1.mp436.98 MiB
.pad/317.21 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/24 - Microservices based Architectures.mp434.18 MiB
.pad/4325.99 KiB
[TutsNode.net] - System Design for Big Data Pipelines/10 - Infrastructure and Deployments/60 - Processing Jobs Deployments.mp433.34 MiB
.pad/5162.54 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/78 - Analyze CJA Scaling.mp433.23 MiB
.pad/6276.01 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/85 - Draw SLA Pipeline Flowchart.mp432.61 MiB
.pad/7400.69 KiB
[TutsNode.net] - System Design for Big Data Pipelines/10 - Infrastructure and Deployments/62 - Geographical Distribution.mp431.67 MiB
.pad/8342.28 KiB
[TutsNode.net] - System Design for Big Data Pipelines/10 - Infrastructure and Deployments/58 - Infrastructure Technologies.mp431.47 MiB
.pad/929.5 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/87 - Analyze SLA Scaling.mp430.38 MiB
.pad/10118.12 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/27 - Performance Benchmarking for Big Data Pipelines.mp429.87 MiB
.pad/11129.36 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/41 - Stream Processing Design Practices.mp429.69 MiB
.pad/12317.59 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/45 - Distributed File System Pattern.mp429.04 MiB
.pad/13470.29 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/72 - Problem Definition for CJA.mp428.97 MiB
.pad/1427.76 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/25 - Batch Pipelines Best Practices.mp428.71 MiB
.pad/15294.54 KiB
[TutsNode.net] - System Design for Big Data Pipelines/6 - Data Transport Design/35 - Event Streaming Pattern.mp428.05 MiB
.pad/16458.37 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/26 - Realtime Pipelines Best Practices.mp428.04 MiB
.pad/17474.07 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/19 - Select Technologies.mp427.88 MiB
.pad/18127.61 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/40 - Batch Processing Design Practices Part 2.mp427.49 MiB
.pad/1913.29 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/43 - Input and Output Considerations for Processing.mp426.61 MiB
.pad/20402.13 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/86 - Create SLA Skeleton Design.mp426.61 MiB
.pad/21402.29 KiB
[TutsNode.net] - System Design for Big Data Pipelines/10 - Infrastructure and Deployments/61 - Databases and Queues Deployments.mp426.41 MiB
.pad/2289.36 KiB
[TutsNode.net] - System Design for Big Data Pipelines/9 - Serving Design/53 - Query Interface Pattern.mp426.32 MiB
.pad/23188.64 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/14 - Analyze Pipeline Input.mp425.7 MiB
.pad/24310.36 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/44 - Processing Engine Technologies.mp424.83 MiB
.pad/25171.31 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/37 - Data Processing Patterns.mp424.69 MiB
.pad/26321.43 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/13 - Analyze Functional Requirements.mp424.59 MiB
.pad/27419.4 KiB
[TutsNode.net] - System Design for Big Data Pipelines/4 - Scalable Pipelines Design Principles/23 - Distributed Architectures.mp424.51 MiB
.pad/28498.33 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/18 - Analyze Scaling.mp424.43 MiB
.pad/2971.31 KiB
[TutsNode.net] - System Design for Big Data Pipelines/6 - Data Transport Design/34 - Request Response Pattern.mp423.5 MiB
.pad/30507.75 KiB
[TutsNode.net] - System Design for Big Data Pipelines/1 - Introduction Expectations/1 - Need for Quality Pipeline Design.mp422.98 MiB
.pad/3117.77 KiB
[TutsNode.net] - System Design for Big Data Pipelines/5 - Data Acquisition Design/28 - File Transfer Pattern.mp422.37 MiB
.pad/32137.73 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/74 - Analyze CJA Input Data.mp422.1 MiB
.pad/33405.79 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/46 - Relational Database Pattern.mp421.63 MiB
.pad/34383.61 KiB
[TutsNode.net] - System Design for Big Data Pipelines/1 - Introduction Expectations/2 - Course Coverage and Prerequisites.mp421.49 MiB
.pad/3511.05 KiB
[TutsNode.net] - System Design for Big Data Pipelines/6 - Data Transport Design/33 - Extract Load Pattern.mp421.45 MiB
.pad/3653.79 KiB
[TutsNode.net] - System Design for Big Data Pipelines/5 - Data Acquisition Design/32 - Data Acquisition Design Practices.mp421.2 MiB
.pad/37309.15 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/51 - Data Storage Design Practices 1.mp421.13 MiB
.pad/38381.59 KiB
[TutsNode.net] - System Design for Big Data Pipelines/5 - Data Acquisition Design/30 - Ingestion API Pattern.mp420.89 MiB
.pad/39111.83 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/79 - Select Technologies for CJA.mp420.85 MiB
.pad/40148.51 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/17 - Create a Skeleton Design.mp420.24 MiB
.pad/41265.14 KiB
[TutsNode.net] - System Design for Big Data Pipelines/9 - Serving Design/54 - Serving API Pattern.mp420.18 MiB
.pad/42331.28 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/88 - Select SLA Technologies.mp420.05 MiB
.pad/43464.47 KiB
[TutsNode.net] - System Design for Big Data Pipelines/5 - Data Acquisition Design/29 - Extraction Client Pattern.mp419.92 MiB
.pad/4483.67 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/38 - Distributed Processing with Big Data.mp419.64 MiB
.pad/45363.54 KiB
[TutsNode.net] - System Design for Big Data Pipelines/12 - Serviceability/71 - Pipeline Troubleshooting.mp419.56 MiB
.pad/46448.27 KiB
[TutsNode.net] - System Design for Big Data Pipelines/9 - Serving Design/57 - Data Serving Design Practices.mp419.37 MiB
.pad/47132.18 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/47 - Document Database Pattern.mp419.12 MiB
.pad/48392.53 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/50 - Distributed Cache Pattern.mp419.05 MiB
.pad/49462.07 KiB
[TutsNode.net] - System Design for Big Data Pipelines/5 - Data Acquisition Design/31 - Pub Sub Acquisition Pattern.mp418.89 MiB
.pad/50107.89 KiB
[TutsNode.net] - System Design for Big Data Pipelines/9 - Serving Design/55 - Push Client Pattern.mp418.46 MiB
.pad/5142.55 KiB
[TutsNode.net] - System Design for Big Data Pipelines/6 - Data Transport Design/36 - Data Transport Design Practices.mp418.32 MiB
.pad/52182.07 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/15 - Analyze Nonfunctional Requirements.mp418.27 MiB
.pad/53240.36 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/82 - Study SLA Functional Requirements.mp417.57 MiB
.pad/54438.55 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/52 - Data Storage Design Practices 2.mp417.52 MiB
.pad/55490.11 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/80 - Design Infrastructure and Operations for CJA.mp416.83 MiB
.pad/56174.29 KiB
[TutsNode.net] - System Design for Big Data Pipelines/11 - Security/63 - Pipeline Security by Design.mp416.63 MiB
.pad/57378.5 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/4 - The Big Data Pipeline Network.mp416.41 MiB
.pad/5892.46 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/11 - Data Pipeline Operations.mp416.38 MiB
.pad/59121.84 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/21 - Develop a Test Strategy.mp416.29 MiB
.pad/60217.7 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/5 - Data Acquisition Blocks.mp415.97 MiB
.pad/6133.87 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/48 - Columnar Database Pattern.mp415.23 MiB
.pad/62278.16 KiB
[TutsNode.net] - System Design for Big Data Pipelines/7 - Data Processing Transformation Design/42 - Batch vs Realtime Processing.mp415.22 MiB
.pad/63282.69 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/73 - Study CJA Functional Requirements.mp414.98 MiB
.pad/6418.77 KiB
[TutsNode.net] - System Design for Big Data Pipelines/12 - Serviceability/70 - Data to Monitor.mp414.78 MiB
.pad/65224.13 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/6 - Data Transport Blocks.mp414.25 MiB
.pad/66260.16 KiB
[TutsNode.net] - System Design for Big Data Pipelines/8 - Storage Design/49 - Graph Database Pattern.mp414.21 MiB
.pad/67296.94 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/16 - Draw a Pipeline Flowchart.mp414.19 MiB
.pad/68315.17 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/12 - System Design Process Overview.mp414 MiB
.pad/69511.75 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/89 - Define SLA Infrastructure and Operations.mp413.87 MiB
.pad/70128.02 KiB
[TutsNode.net] - System Design for Big Data Pipelines/3 - System Design Process/20 - Design Infrastructure and Operations.mp413.76 MiB
.pad/71245 KiB
[TutsNode.net] - System Design for Big Data Pipelines/9 - Serving Design/56 - Publish Subscribe Pattern.mp413.41 MiB
.pad/7290.32 KiB
[TutsNode.net] - System Design for Big Data Pipelines/11 - Security/67 - MultiTenancy Considerations.mp412.54 MiB
.pad/73466.53 KiB
[TutsNode.net] - System Design for Big Data Pipelines/12 - Serviceability/68 - Elements of Serviceability.mp412.43 MiB
.pad/7469.77 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/10 - Data Pipeline Infrastructure.mp412.33 MiB
.pad/75178.04 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/7 - Data Processing Blocks.mp412.15 MiB
.pad/76363.46 KiB
[TutsNode.net] - System Design for Big Data Pipelines/12 - Serviceability/69 - Monitoring Pipelines.mp411.61 MiB
.pad/77402.6 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/81 - Problem Definition for SLA.mp411.55 MiB
.pad/78455.82 KiB
[TutsNode.net] - System Design for Big Data Pipelines/11 - Security/66 - Privacy Considerations.mp411.48 MiB
.pad/7919.77 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/9 - Data Serving Blocks.mp410.75 MiB
.pad/80260.79 KiB
[TutsNode.net] - System Design for Big Data Pipelines/2 - Building Blocks for Big Data Pipelines/8 - Data Storage Blocks.mp410.4 MiB
.pad/81103.12 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/83 - Analyze SLA Input Data.mp410.29 MiB
.pad/82213.6 KiB
[TutsNode.net] - System Design for Big Data Pipelines/1 - Introduction Expectations/3 - Cloud Serverless Technologies.mp49.95 MiB
.pad/8346.75 KiB
[TutsNode.net] - System Design for Big Data Pipelines/10 - Infrastructure and Deployments/59 - Microservices Deployments.mp49.48 MiB
.pad/8421.86 KiB
[TutsNode.net] - System Design for Big Data Pipelines/11 - Security/65 - Secure Data Storage.mp49.32 MiB
.pad/85183.72 KiB
[TutsNode.net] - System Design for Big Data Pipelines/14 - Use Case II Suspicious Login Alerting SLA/84 - Study SLA NonFunctional Requirements.mp49.24 MiB
.pad/86266.84 KiB
[TutsNode.net] - System Design for Big Data Pipelines/13 - Use Case I Customer Journey Analytics CJA/75 - Study CJA NonFunctional Requirements.mp49.12 MiB
.pad/87388.74 KiB
[TutsNode.net] - System Design for Big Data Pipelines/11 - Security/64 - Secure External Interfaces.mp47.85 MiB
.pad/88148.92 KiB
[TutsNode.net] - System Design for Big Data Pipelines/15 - Conclusion/90 - Thank You.mp42.16 MiB