Details for this torrent 

Udemy - A Big Data Hadoop and Spark project for absolute beginne
Type:
Other > Other
Files:
273
Size:
3.66 GiB (3932179756 Bytes)
Uploaded:
2020-12-30 08:53:18 GMT
By:
tuts756
Seeders:
4
Leechers:
0
Comments
0  

Info Hash:
E54E4CD369563B62CD3D61813146CD18318347D1




(Problems with magnets links are fixed by upgrading your torrent client!)
Description

Get started with Big Data quickly leveraging free cloud cluster and solving a real world use case!  Learn Hadoop, Hive , Spark (both Python and Scala) from scratch!

Learn to code Spark Scala & PySpark like  a real world developer. Understand real world coding best practices, logging, error handling , configuration management using both Scala and Python.

Project

A bank is launching a new credit card and wants to identify prospects it can target in its marketing campaign.

It has received prospect data from various internal and 3rd party sources. The data has various issues such as missing or unknown values in certain fields. The data needs to be cleansed before any kind of analysis can be done.

Since the data is in huge volume with billions of records, the bank has asked you to use Big Data Hadoop and Spark technology to cleanse, transform and analyze this data.

What you will learn :

    Big Data, Hadoop concepts
    How to create a free Hadoop and Spark cluster using Google Dataproc
    Hadoop hands-on – HDFS, Hive
    Python basics
    PySpark RDD – hands-on
    PySpark SQL, DataFrame – hands-on
    Project work using PySpark and Hive
    Scala basics
    Spark Scala DataFrame
    Project work using Spark Scala
    Spark Scala Real world coding framework and development using Winutil, Maven and IntelliJ.
    Python Spark Hadoop Hive coding framework and development using PyCharm
    Building a data pipeline using Hive , PostgreSQL, Spark
    Logging , error handling and unit testing of PySpark and Spark Scala applications
    Spark Scala Structured Streaming
    Applying spark transformation on data stored in AWS S3 using Glue and viewing data using Athena

Prerequisites :

    Some basic programming skills
    Some knowledge of SQL queries

Who this course is for:

    Beginners who want to learn Big Data or experienced people who want to transition to a Big Data role
    Big data beginners who want to learn how to code in the real world

Requirements

    Students should have some programming background and some knowledge of SQL queries.

Last Updated 12/2020

[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1. Fast queries with Hive Partitioning.mp4116.67 MiB
TutsNode.com.txt63 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14.1 FutureXSparkScalaProject_organize.zip108.74 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.2 winutils.zip36.12 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/6.1 FuturexMiscSparkScala_Filter.zip33.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.2 FutureXSparkScalaProject-spark-submit.zip26.51 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.2 FuturexMiscSparkScala.zip18.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.1 retailstore.csv306 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.2 hive-hdfs-commands.txt1.51 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.2 FuturexMiscSparkScala (1).zip18.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.2 PySpark_DataFrame.zip17.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.2 PySpark_udf_and_join.zip15.99 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.2 spark_installation_on_colab.py1.33 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.1 PySpark_udf_and_join.zip15.99 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.1 pyspark_rdd.zip15.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/1.1 FutureXScalaUnitTesting.zip15.62 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/12.1 FutureXSparkScalaProject_Postgres.zip12.28 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.2 retailstore.csv279 B
.pad/06 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/2. Rapid Revision - Big Data, Hadoop and Spark concepts.mp4108.67 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.2 pyspark_bank_marketing_project.zip14.7 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/6.1 ScalaBasics.zip12.22 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.1 Spark_Installation_on_Colab.zip11.88 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/6.1 spark-hadoop-commands.txt1.75 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/9.1 FutureXSparkScalaProject.zip11.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.1 pyspark_bank_marketing_project.py2.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/7.1 SparkHelloWorld.zip9.65 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/5.1 ScalaHelloWorld.zip7.96 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/9.1 FuturexMiscSparkScala.zip7.79 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/1.1 scala-basics.txt1.93 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.1 pyspark_dataframe.py4.5 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/2.1 spark-scala-dataframe.txt2.46 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.2 python_basics.py4.39 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/3.1 spark-scala-bank-marketing-project.txt1.28 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.1 python_basics.py4.39 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.1 pyspark_udf_and_join.py3.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/2.1 Creating a Data Lake using S3, Glue, Athena.zip1.4 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.2 pyspark_udf_and_join.py3.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/2.1 cloudera-gcp.txt3.42 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/3.1 DataPipeline_Logger2.zip2.75 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/2.1 DataPipeline_logging_1.zip2.61 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/6.1 Triggering AWS Glue job with a serverless Lambda function.zip526 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/4.1 DataPipeline_psycopg2.zip2.4 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/7.1 glue_pyspark_bank_marketing_project.zip1.23 KiB
[TGx]Downloaded from torrentgalaxy.to .txt585 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1.1 hive-partition.txt2.29 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/7.1 common.zip1.7 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/6.1 DataPipeline_v4.zip1.69 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/2.1 hive-bucketing.txt1.17 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/5.1 DataPipeline_v3.zip1.55 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/1.1 DataPipeline_v5.zip1.48 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/3.1 spark2-cloudera.txt1.47 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/10.1 Postgres-course-catalog.sql1.2 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/4.1 DataPipeline_v2.zip1.19 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/1.1 pom.zip989 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/2.1 DataPipeline_v1.zip951 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.2 persist_transformed_df.zip867 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/3.1 test_transformer.zip826 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.1 StructuredStreamingWindowAggregation.zip823 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/8.1 StructuredStreamingWindowAggregation.zip823 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/9.1 SparkTransformerSpec.zip811 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/6.1 SparkTransformerSpec.zip77 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1.1 hello_world_python_spark_hadoop.zip746 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/7.1 StructuredStreamingDemoTimestamp.zip721 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/5.1 SparkTransformerSpec.zip703 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/11.1 Postgres-course-catalog_psql.zip619 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/5. Intellij Maven troubleshooting tips.html59 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/3.1 Postgres-course-catalog.zip579 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.2 sale.zip53 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.1 githuhb-link.txt42 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.1 files.zip509 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.1 files (1).zip509 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/1.1 test.zip455 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/15.1 log4j.zip343 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.1 pg_course.zip315 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.1 spark-submit.txt222 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/8.1 failtests.txt10 B
.pad/1190.41 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1. Reading from Hive and Writing to Postgres.mp4104.1 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/18. PySpark - Reading Configuration from properties file/2.1 DataPipeline_read_config.zip917.98 KiB
.pad/24.24 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1. PySpark Hadoop Hive development environment using PyCharm and Winutils.mp497.54 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/3.1 FutureXSparkScalaProject_writeToHive.zip396.86 KiB
.pad/371.31 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14. Organizing code with Objects and Methods.mp491.17 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/1.1 advanced_spark_datasets.zip736.25 KiB
.pad/4109.85 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1. Project - Bank prospects marketing data transformation using Hadoop and Spark.mp487.76 MiB
.pad/5248.49 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2. Reading Configuration from JSON using Typesafe.mp485.05 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/5.1 DataPipeline_postgres_jdbc.zip911.76 KiB
.pad/658.05 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2. Storing data in HDFS and querying with Hive.mp482.07 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2.1 FutureXSparkScalaProject_typesafe_config_parser.zip358.89 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1.1 FutureXSparkScalaProject_readHivewritePG.zip353.51 KiB
.pad/7235.62 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/1. Creating a free Hadoop and Spark cluster using Google Dataproc.mp479.19 MiB
.pad/8833.52 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4. PySpark RDD.mp478.49 MiB
.pad/9522.16 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/2. Managing log level through a configuration file.mp476.71 MiB
.pad/10292.82 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/7. Project - Bank prospects data transformation using S3, Glue & Athena services.mp476.16 MiB
.pad/11859.84 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/6. Scala basics using IntelliJ.mp475.53 MiB
.pad/12481.35 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/2. Spark Transformation unit testing using ScalaTest.mp473.31 MiB
.pad/13705.81 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3. Python basics.mp471.27 MiB
.pad/14745.62 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5. PySpark - Spark SQL and DataFrame.mp469.44 MiB
.pad/15573.59 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/2. Cloudera QuickStart VM Installation on GCP.mp466.11 MiB
.pad/16908.47 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/1. Scala Unit Testing using JUnit & ScalaTest.mp462.38 MiB
.pad/17639.59 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/5. Throwing Custom Error and Intercepting Error Message.mp460.33 MiB
.pad/18689.57 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/4. PySpark PostgreSQL interaction with Psycopg2 adapter.mp459.54 MiB
.pad/19473.25 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/6. Triggering AWS Glue job with a serverless AWS Lambda function.mp457.79 MiB
.pad/20214.45 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/16. Exception Handling with try, catch, Option, Some and None.mp454.83 MiB
.pad/21169.62 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/1. Scala basics.mp454.8 MiB
.pad/22202.64 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/4. Creating and reusing SparkSession.mp453.55 MiB
.pad/23465.43 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/4. Error Handling with try except and raise.mp453.04 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/2.1 FutureXSparkScalaProject_ScalaTest.zip980.54 KiB
.pad/246.49 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3. Joins - Left, Right, Inner, Outer.mp450.01 MiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/4.1 FutureXSparkScalaProject.zip978.1 KiB
.pad/2533.35 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/5. ETL transformation using AWS Glue.mp448.45 MiB
.pad/26560.31 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/9. Enabling Hive Support in Spark Session.mp446.33 MiB
.pad/27681.54 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/6. Separating out Ingestion, Transformation and Persistence code.mp446.01 MiB
.pad/281013.92 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/1. Exporting the project to an uber jar.mp445.9 MiB
.pad/2998.8 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/6. Running PySpark on a Hadoop Cluster.mp445.45 MiB
.pad/30565.48 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/6. Filtering Stream.mp444.84 MiB
.pad/31166.7 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/5. Spark DataFrame.mp444.5 MiB
.pad/32509.07 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/1. Ingesting data from Hive.mp443.34 MiB
.pad/33678.16 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/15. Implementing Log4j SLf4j Logging.mp443.29 MiB
.pad/34723.08 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/1. Python Logging.mp442.01 MiB
.pad/351012.1 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/3. Having custom logger for each Python class.mp441.98 MiB
.pad/3623.82 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/4. AWS Glue crawler and AWS Athena query tool.mp441.93 MiB
.pad/3767.85 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/7. Hello World Spark Scala using IntelliJ.mp441.39 MiB
.pad/38625.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/2. Big Data Hadoop concepts/2. Hadoop concepts.mp441.23 MiB
.pad/39791.72 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5. Streaming Aggregation.mp438.7 MiB
.pad/40310.07 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/8. Aggregation in a time window.mp437.64 MiB
.pad/41365.31 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/3. Running Spark 2 with Hive on Cloudera QuickStart VM.mp436.58 MiB
.pad/42429.02 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2. Installing Spark on Google Colab.mp435.45 MiB
.pad/43564.86 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/5. Hello World Scala.mp435.1 MiB
.pad/44925.25 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/2. Spark SQL DataFrame using Scala.mp435.03 MiB
.pad/45996.51 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/5. Spark PostgreSQL interaction with JDBC driver.mp434.64 MiB
.pad/46371.56 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/4. Managing input parameters using a Scala Case Class.mp434.28 MiB
.pad/47739.3 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/13. Importing a project into IntelliJ.mp434.24 MiB
.pad/48780.43 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/10. Installing PostgreSQL.mp432.78 MiB
.pad/49222.69 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/2. Unit testing PySpark transformation logic.mp431.91 MiB
.pad/5096.7 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/12. Fetching PostgresSQL data to a Spark DataFrame.mp431.84 MiB
.pad/51166.9 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/2. Structuring code with classes and methods.mp431.71 MiB
.pad/52295.98 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/3. Writing data to a Hive Table.mp431.17 MiB
.pad/53847.86 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/7. Adding timestamp to streaming data.mp430.67 MiB
.pad/54340.81 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2. User Defined Function (UDF).mp429.8 MiB
.pad/55203.7 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/1. Spark concepts.mp428.12 MiB
.pad/56898.92 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/5. Doing spark-submit locally.mp426.5 MiB
.pad/57516.32 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4. Uber Jar spark-submit on Cloudera QuickStart VM.mp425.01 MiB
.pad/581014.85 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/2. AWS data lake - S3, Glue and Athena introduction.mp424.46 MiB
.pad/59549.06 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4. Writing streaming data to a Hive table.mp424.36 MiB
.pad/60656.88 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/4. Catching Exception using assertThrows.mp423.39 MiB
.pad/61627.26 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/1. Python unittest framework.mp423.37 MiB
.pad/62648.27 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/3. Installing PostgreSQL.mp423.3 MiB
.pad/63714.59 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/3. Bank prospects marketing project in Scala.mp422.52 MiB
.pad/64490.15 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/18. PySpark - Reading Configuration from properties file/1. Organizing code further.mp421.07 MiB
.pad/65948.79 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/2. Fast queries with Hive Bucketing.mp421.02 MiB
.pad/66998.45 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/2. Big Data Hadoop concepts/1. Big Data concepts.mp419.74 MiB
.pad/67267.48 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/18. PySpark - Reading Configuration from properties file/2. Reading configuration from a property file.mp419.43 MiB
.pad/68588.02 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6. Persisting transformed data in PostgreSQL.mp418.78 MiB
.pad/69225.76 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2. Streaming data from files.mp418.78 MiB
.pad/70230.01 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/2. Transforming ingested data.mp418.67 MiB
.pad/71341.1 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/3. Unit testing to catch an Exception.mp417.57 MiB
.pad/72440.61 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/3. Create a data lake on AWS S3.mp415.59 MiB
.pad/73416.85 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/1. Introduction/1. Introduction.mp414.57 MiB
.pad/74441.18 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/1. Introduction to AWS data lake use case.mp413.58 MiB
.pad/75426.94 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/4. PySpark - spark submit.mp413.05 MiB
.pad/76973.52 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/6. Testing with assertResult.mp412.95 MiB
.pad/7750.07 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/3. Unit testing an error.mp412.88 MiB
.pad/78123.21 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/2. Installing JDK on a local Machine.mp412.7 MiB
.pad/79302.83 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/3. Batch Vs Streaming code.mp412.63 MiB
.pad/80377.71 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/1. Advanced Spark datasets.mp412.63 MiB
.pad/81380.6 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/7. Testing with Matchers.mp412.06 MiB
.pad/82965.75 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/11. psql command line interface for PostgreSQL.mp411.03 MiB
.pad/83989.75 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/9. Sharing fixtures.mp410.88 MiB
.pad/84119.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/8. Failing tests intentionally.mp410.78 MiB
.pad/85221.97 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/9. Tumbling window and Sliding window.mp49.39 MiB
.pad/86623.35 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8. Configuring HADOOP HOME on Windows using Winutils.mp48.08 MiB
.pad/87940.37 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/3. How Spark works.mp47.54 MiB
.pad/88474.69 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/1. Structured Streaming concepts.mp46.06 MiB
.pad/89963.02 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/2.2 retailstore_large.zip5.38 MiB
.pad/90632.31 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1.2 retailstore_large.zip5.37 MiB
.pad/91642.31 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/3. Installing IntelliJ IDEA.mp45.22 MiB
.pad/92793.67 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/4. Adding Scala Plugin to IntelliJ.mp42.59 MiB
.pad/93421.08 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/1. Spark Scala real world coding introduction.mp42.46 MiB
.pad/94549.65 KiB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/5.2 FutureXSparkScalaProject_assetThrowsIntercept.zip1.02 MiB