Видео

Please guys bring up tutorials for gcp data engineering since there are lots videos availavle for aws n azure.

nice video. Could you please share the scripts?

Very informative video :) Keep going

thanks for this vdo really needed thnx

sir can we code spark in eclipse

Hi Arpit is Spark having good career scope in AI era

Code plz

can u please send me github code

really helpful video. it helped me a alot

peovide the code sir

please can you provide the code for this

How can we handle the case where source records are closed / deleted ?

what about lambda & kappa architecture . Can't we say this in the interview?

A person on RUclips who actually knows Spark

Thankssss pelase make videos on ur daily work

Thanks a lot, I think we can use row_number window function to get updated records by using partitions by emp_id and order by date desc. Finally can filter for row_number=1

The point of using Apache Spark is to handle large datasets so why are you converting the values to pandas... Pointless video in real world scenarios.

हे सर्व फुलपाखरांचे फोटो आणि व्हिडिओ कुठे घेतले आहेत.? म्हणजे गावाकडे की पुण्यामध्ये.? आणि पुण्यात घेतले असतील तर नेमका location काय आहे.?

Could you please share methods or some pseudo code to implement this concept .. Arpit !!!!

Very useful information. Clearly explained.Thank you arpit❤

best course ❤🔥

Thanks man your are amazing 😍❤❤❤

Without any experience in data engineering can we join as a DE from different non IT background. If yes how supportive is the team.

Hi Arpit, do you have any real-time Spark-scale projects in a cloud environment? I searched your playlist but couldn't find any relevant videos.

Hi can you provide the data set we will try from our end

Promo-SM 😔

बहुत अच्छी जानकारी दी ऐसी वीडियो रेगुलर बनाते रहो

Hey, Arpit! Do u suggest going with databricks after learning pyspark, even though i want to make a career as an AWS data engineer, ..or would it be more apt for me to just go with aws glue instead?

Hi Arpit! I have been practicing PySpark for a while now, studied and implemented most of the concepts you mentioned in the video as individual concepts. I am looking for projects/use cases where I can combine all the concepts building a meaningful end result. Please could you suggest some? Thanks!

Great Video. Nicely explained. Thank you 😊

When you do repartition and then partitionby already data is partitioned now based on partitionby column they why no of part file depend on repartition() again?

Nice videos

Nice explanation

Very good explanation

2 months big data which company is hiring.. Not suitable for freshers and also for some experienced. Join u will know..😂😂

Wooo great sir.....step by step ❤

Its very basic. I would suggest to keep in python code rather than sql.

beautiful explanation

i am getting ssh connection timeout in gitbash. What should be the reason behind this ?

GCP

Is spark + Scala roles does exit?

File Sink not discussed I was looking for file sink only

Hi I need big data real time projects for adding in my resume.

So life saving 🙌🏻 Thankyou

Playlist is really helpful. Explained from very basic to high level including important minor services

Good initiative.. Waiting for gcp...

Olap cubes and data warehouse are Different(in diagram it is marked together ). Data warehouse warehouse persist data , in Bigdata it will be in data lake gold layer.

AWS

azure data enginner is in huge demand as compared to aWS

Sirrrrr.... you are back. I started my data engineering journey from here. I learnt basics of GCP but now in my job AWS will be used. I am happy you chose AWS.