June 5, 2019 – Clear ur Doubt

How to add a new column to a Dataframe in Apache Spark

Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at withColumn() function in Apache Spark SQL API. withColumn(String columnName, Column newColumn) is used to add a new column to a dataframe. Let’s look at the below code snippet in spark-shell for Read more

Jun 05

How to rename a column in a Dataframe in Apache Spark

Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at withColumnRenamed() function in Apache Spark SQL API. withColumnRenamed(String columnName, String newColumnName) is used to rename a column in a Dataframe. Let’s look at the below code snippet in spark-shell for Read more

S	M	T	W	T	F	S
						1
2	3	4	5	6	7	8
9	10	11	12	13	14	15
16	17	18	19	20	21	22
23	24	25	26	27	28	29
30