- Pune: +91 82 82 82 9805
- Karad: +91 82 82 82 9806 / 02164-225500, 225800
Course Name :
Batch Schedule : 18-Jul-2020 To 26-Jul-2020
Timings : 9:00 AM To 12:30 PM
- Students
- Freshers
- Working Professionals
- Apache Spark 2
- Spark concepts
- Distributed Computing Challenges
- Spark Architecture & Components
- Spark Installation & Deployment
- PySpark
- PySpark Shell
- PySpark installation
- Executing Spark Python programs
- Spark Web UI
- Spark in Pycharm IDE
- Spark on Databricks cloud
- Apache Spark 2 - Spark Core
- Spark RDD, Transformations & Actions, Data Load & Save
- RDD characteristics & execution
- Accumulators & Broadcast variables
- RDD Internals: Distributed/Partitions, Lineage, Persistence
- Implementing & Submitting Spark Job
- Execution of Spark Job (RDD)
- DAG visualization
- Apache Spark 2 - Spark SQL
- Spark SQL Introduction
- Architecture
- SQLContext & SparkSession
- Data Frames & Datasets
- Data Frame Columns & Expressions
- Implementing & Executing Spark SQL job
- User Defined Functions
- File Formats & Loading data
- Spark SQL data types & schema
- Spark SQL functions
- Global/Temporary views
- Partitioning & Bucketing
- SQLContext & HiveContext
- Apache Spark 2 - Spark Streaming
- Streaming concepts
- Microbatches vs Continuous job
- Spark Streaming concepts
- Spark Structured Streaming concepts
- Triggers, Event time-based processing & Watermark
- Windowing Concept, Window Operations
- Input sources & output sinks
- Structured Streaming application execution
- Apache Kafka
- Kafka Architecture
- Kafka Cluster Components & Configuration
- Kafka Applications
- Kafka Python client
- Kafka Spark Source & Sink
- Linux commands familiarity
- Any RDBMS (like Oracle or MySQL)
- Python3 programming skills
- Hive architecture - Join Hive webinar to learn
- XML awareness
- This course is designed for Spark developers and covers developer machine installation. Spark administration and cluster setup is beyond scope of this course.
- This course doesn’t include machine learning or data science using Spark.
- Considering details to learn and participant's queries we may need to extend timings every day.
- You need to have a Hive setup installed on your machine before the session. You may use the downloaded VM or follow setup instructions in your enrolment mail. You may take help from the instructor before the session.
- Understand Spark architecture and components
- Gain confidence in Spark dataframes and Spark SQL
- Spark structured streaming with Apache Kafka
- Core i3 (64-bit) and above
- RAM Min 8 GB. Recommended: 16 GB+.
- 64-bit Linux – Ubuntu.
- You may use VM with the above configuration (available for download).
| Sr.No | Batch Code | Start Date | End Date | Time |
|---|---|---|---|---|
| 1 | BD Spark & Kafka- O-01 | 18-Jul-2020 | 26-Jul-2020 | 9:00 AM To 12:30 PM |
Contact us
Sunbeam Hinjawadi Pune
Authorized Training Centre of C-DAC ACTS
"Sunbeam IT Park", Ground Floor, Phase 2 of Rajiv Gandhi Infotech Park, Hinjawadi, Pune - 411057, MH-INDIA
+91 82 82 82 9805 / +91 82 82 82 9806
Sunbeam Karad
Authorized Training Centre of C-DAC ACTS
'Anuda Chambers', 203 Shaniwar Peth, Near Gujar Hospital, Karad - 415 110, Dist. Satara, MH-INDIA.
+91 82 82 82 9806 / 02164 - 225500 , 225800