Skip to content
Latest Posts:
Creating test data using Python
How to replace multiple strings with their corresponding replacement strings in Scala
How to make the first character uppercase of each word of a List in Scala

Clear ur Doubt

  • Home
  • Technologies
    • Scala
    • Java
    • Hadoop
    • Apache Spark
    • C
  • Tips & Tricks
    • Unix
    • Java 8
  • Projects
    • Python
      • Simple ETL Pipeline
  • Home
  • Blog
  • dataframe

Tag: dataframe

Jun 05

How to add a new column to a Dataframe in Apache Spark

Sai Gowtham BadvityLeave a commentApache Spark, Scaladataframe, Scala, Spark, withColumn

Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at withColumn() function in Apache Spark SQL API. withColumn(String columnName, Column newColumn) is used to add a new column to a dataframe. Let’s look at the below code snippet in spark-shell for Read more

Jun 05

How to rename a column in a Dataframe in Apache Spark

Sai Gowtham BadvityLeave a commentApache Spark, Scaladataframe, spark-shell, withcolumnrenamed

Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at withColumnRenamed() function in Apache Spark SQL API. withColumnRenamed(String columnName, String newColumnName) is used to rename a column in a Dataframe. Let’s look at the below code snippet in spark-shell for Read more

Recent Posts

  • Creating test data using Python
  • How to replace multiple strings with their corresponding replacement strings in Scala
  • How to make the first character uppercase of each word of a List in Scala

Recent Comments

  • Sai Gowtham Badvity on Calculator program in Scala
  • Sai Aditya on Calculator program in Scala
  • pragadeeshwaran on How to add a new column and update its value based on the other column in the Dataframe in Spark
June 2025
S M T W T F S
1234567
891011121314
15161718192021
22232425262728
2930  
« Aug    
Copyright © All rights reserved.
University Hub by WEN Themes
Scroll Up