Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a program to demonstrate Array and ArrayBuffer objects in Scala. Scala arrays are similar to Java arrays. ArrayBuffer will provide a way to add elements at the Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at the Option type in Scala. Scala has a special type called “Option” to handle optional values. In programming world, sometimes a variable will have null instead of actual Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at the steps to find the word counts in a file using Spark 2.4.3. Input file:
|
1 2 3 4 5 6 7 |
Hey there! Welcome to clearurdoubt.com. Happy Learning. Hope you find these articles useful! Happy Learning. |
Spark shell statements:
|
1 2 3 4 5 6 7 8 |
val rdd = spark.sparkContext.textFile("/clearurdoubt/test_file.txt") // Read the input file val words = rdd.flatMap(line => line.split(" ")).filter(word => !word.isEmpty) // split the input lines to words and ignore the empty ones. words.cache // Cache the resource for future use val totalWords = words.count // total words in the input file val pairs = words.map(word => (word, 1)) // parse the words into (word, noOfOccurence) pairs val wordCounts = pairs.reduceByKey(_ + _).collect // finding the each word count in terms of pairs and collecting them into an Array |
Output:
|
1 2 3 |
totalWords: Long = 15 wordCounts: Array[(String, Int)] = Array((Learning.,2), (Hey,1), (Welcome,1), (Happy,2), (Hope,1), (find,1), (you,1), (there!,1), (to,1), (clearurdoubt.com.,1), (articles,1), (these,1), (useful!,1)) |
Happy Learning! Please leave a reply Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a program to demonstrate the Match Expression in Scala. Match Expression is used to implement Java switch statement flow in Scala. Let’s look at the sample program:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
package com.clearurdoubt object MatchExpressionDemo { def main(args: Array[String]) { matchExpression(10) matchExpression(10.0) matchExpression("10.0") matchExpression('C') } def matchExpression(ex: Any) = ex match { case a: Double => println(s"$a is a Double.") case b: Int => println(s"$b is a Integer.") case c: String => println(s"$c is a String.") case _ => println(s"$ex is something else.") } } |
Output: Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a program to demonstrate the Named and Default parameters in Scala. Named Parameters: When a function is defined, we have to pass the parameters in the same order as Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a program to demonstrate the Repeated Parameters in Scala. Repeated Parameters are useful when passing variable length argument list i.e., the function is capable of accepting any number of Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a Scala program to sort Employees objects based on their experience using Ordered trait.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
package com.clearurdoubt class Employee(val name: String, val experience: Double, val salary: Double) extends Ordered[Employee] { override def compare(employee2: Employee) = this.experience compare employee2.experience override def toString = s"$name : $experience : $salary" } object Employee { def main(args: Array[String]) { val employees = List(new Employee("Ram", 2.09, 22000.00), new Employee("Raghu", 1.5, 20000.00), new Employee("Chaitanya", 3.2, 27000.00)) println("Employees: \n" + employees) println("Employees sorted based on experience: \n" + employees.sorted) } } |
Output: We have to implement compare function in Ordered trait to make a custom Read more
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a Scala program to sort a List of items. The “sorted()” function will sort the list of items based on their natural ordering. Let’s look at the program:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
package com.clearurdoubt object ListSortDemo { def main(args: Array[String]) = { val numbers = List(12, 10, 9, 1, 15, 11, 8, 4) val strings = List("Gowtham", "Avinash", "Prajith", "Karthik") println("Numbers: \n" + numbers) println("Sorted Numbers: \n" + numbers.sorted) println("Strings: \n" + strings) println("Sorted Strings: \n" + strings.sorted) } } |
Hey there! Welcome to ClearUrDoubt.com. In this post, we will look at a Scala program to implement a Calculator operations. Let’s look at the program:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
package com.clearurdoubt class Calculator { def +(a: Int, b: Int): Int = a+b def -(a: Int, b: Int): Int = a-b def *(a: Int, b: Int): Long = a*b def /(a: Int, b: Int): Int = { require(b != 0, "denominator can not be 0") a/b } } object Calendar { def main(args: Array[String]) = { val calc = new Calculator() println("Addition: " + calc.+(10, 2)) println("Subtraction: " + calc.-(10, 2)) println("Multiplication: " + calc.*(10, 2)) println("Division: " + calc./(10, 2)) //println("Division: " + calc./(10, 0)) } } |
Output: We have created a Calculator class with 4 typical calculator methods +(addition), -(subtraction), *(multiplication) Read more
“Hello World..!” – Probably the first message that any developer tries to print on the console, while learning a new programming language. Let’s write a basic Scala program to print “Hello World..!” message on the console and go through each Read more