Apache 2.0 Spark with Scala
  • Introduction
  • Introduction
    • Introduction
  • Section 1: Getting Started
    • 1. Warning about Java 9 and Spark2.3!
    • 2. Introduction, and Getting Set Up
    • 3. [Activity] Create a Histogram of Real Movie Ratings with Spark!
  • Section 2: Scala Crash Course
    • 4. [Activity] Scala Basics, Part 1
    • 5. [Exercise] Scala Basics, Part 2
    • 6. [Exercise] Flow Control in Scala
    • 7. [Exercise] Functions in Scala
    • 8. [Exercise] Data Structures in Scala
  • Section 3: Spark Basics and Simple Examples
    • 9. Introduction to Spark
    • 10. Introducing RDD's
    • 11. Ratings Histogram Walkthrough
    • 12. Spark Internals
    • 13. Key /Value RDD's, and the Average Friends by Age example
    • 14. [Activity] Running the Average Friends by Age Example
    • 15. Filtering RDD's, and the Minimum Temperature by Location Example
    • 16. [Activity] Running the Minimum Temperature Example, and Modifying it for Maximum
    • 17. [Activity] Counting Word Occurences using Flatmap()
    • 18. [Activity] Improving the Word Count Script with Regular Expressions
    • 19. [Activity] Sorting the Word Count Results
    • 20. [Exercise] Find the Total Amount Spent by Customer
    • 21. [Exercise] Check your Results, and Sort Them by Total Amount Spent
    • 22. Check Your Results and Implementation Against Mine
  • Section 4: Advanced Examples of Spark Programs
    • 23. [Activity] Find the Most Popular Movie
    • 24. [Activity] Use Broadcast Variables to Display Movie Names
    • 25. [Activity] Find the Most Popular Superhero in a Social Graph
    • 26. Superhero Degrees of Seperation: Introducing Breadth-First Search
    • 27. Superhero Degrees of Seperation: Accumulators, and Implementing BFS in Spark
    • 28. Superhero Degrees of Seperation: Review the code, and run it!
    • 29. Item-Based Collaborative Filtering in Spark, cache(), and persist()
    • 30. [Activity] Running the Similiar Movies Script using Spark's Cluster Manager
    • 31. [Exercise] Improve the Quality of Similiar Movies
  • Section 5: Running Spark on a Cluster
    • 32. [Activity] Using spark-submit to run Spark driver scripts
    • 33. [Activity] Packaging driver scripts with SBT
    • 34. Introducing Amazon Elastic MapReduce
    • 35. Creating Similar Movies from One Million Ratings on EMR
    • 36. Partitioning
    • 37. Best Practices for Running on a Cluster
    • 38. Troubleshooting, and Managing Dependencies
  • Section 6: SparkSQL, DataFrames, and DataSets
    • 39. Introduction to SparkSQL
    • 40. [Activity] Using SparkSQL
    • 41. [Activity] Using DataFrames and DataSets
    • 42. [Activity] Using DataSets instead of RDD's
  • Section 7: Machine Learning with MLLib
    • 43. Introducing MLLib
    • 44. [Activity] Using MLLib to Produce Movie Recommendations
    • 45. [Activity] Using DataFrames with MLLib
    • 46. [Activity] Using DataFrames with MLLib
  • Section 8: Intro to Spark Streaming
    • 47. Spark Streaming Overview
    • 48. [Activity] Set up a Twitter Developer Account, and Stream Tweets
    • 49. Structured Streaming
  • Section 9: Intro to GraphX
    • 50. GraphX, Pregel, and Breadth-First-Search with Pregel.
    • 51. [Activity] Superhero Degrees of Seperation using GraphX
  • Section 10: You Made It! Where to Go from Here.
    • 52. Learning More, and Career Tips
    • 53. Bonus Lecture: Discounts on my other "Big Data" / Data Science Courses.
Powered by GitBook
On this page
  • Activity
  • Exercise
  1. Section 2: Scala Crash Course

6. [Exercise] Flow Control in Scala

Activity

  • For this activity, go ahead and import from the resource the file LearningScala2.scala

  • For Scala, we can control the flow of code

  • For example, if and else control flow in 1 line using Functional Programming

  • You can also use if and else condition with {} syntax

      // Flow control
    
      // If / else syntax
      if (1 > 3) println("Impossible!") else println("The world makes sense.")
      //> The world makes sense.
    
      if (1 > 3) {
          println("Impossible!")
        } else {
            println("The world makes sense.")
        }
  • You can also use case match for certain cases

      // Matching - like switch in other languages:
    
        val number = 3                               
      //> number  : Int = 3
    
      number match {
            case 1 => println("One")
            case 2 => println("Two")
            case 3 => println("Three")
            case _ => println("Something else")
       }
       //> Three
  • This is the syntax for For Loop in Scala

      // For loops
      for (x <- 1 to 4) {
          val squared = x * x
          println(squared)
      }                                         
      //> 1
      //| 4                                              
      //| 9                                              
      //| 16
  • This is the syntax for While Loop in Scala

      // While loops
    
      var x = 10                                      
      //> x  : Int = 10
    
      while (x >= 0) {
          println(x)
          x -= 1
      }                                             
      //> 10
      //| 9                                              
      //| 8                                              
      //| 7                                              
      //| 6                                              
      //| 5                                              
      //| 4                                              
      //| 3                                              
      //| 2                                              
      //| 1                                              
      //| 0
  • This is the syntax for Do While Loop in Scala in 1 line using Functional Programming

      // Do While Loop
      x = 0
      //> 0
    
      do { println(x); x+=1 } while (x <= 10)
      //| 1
      //| 2
      //| 3
      //| 4
      //| 5
      //| 6
      //| 7
      //| 8
      //| 9
      //| 10
  • In Scala, you can print the result returned by the expression, even while not assigning any val to it

      // Expressions
    
      // "Returns" the final value in a block automatically
      {val x = 10; x + 20}                           
      //> res0: Int = 30
    
      println({val x = 10; x + 20})            
      //> 30

Exercise

    // EXERCISE
    // Write some code that prints out the first 10 values of the Fibonacci sequence.
    // This is the sequence where every number is the sum of the two numbers before it.
    // So, the result should be 0, 1, 1, 2, 3, 5, 8, 13, 21, 34

    var prevVal = 0                          
    //> prevVal  : Int = 0
    var prevPrevVal = 1                      
    //> prevPrevVal  : Int = 1
    var i = 0                                
    //> i  : Int = 0

    do{
        println(prevVal)
        val sum = prevPrevVal + prevVal
        prevPrevVal = prevVal
        prevVal = sum
        i += 1
     } while (i < 10)                         
    //> 0
    //| 1
    //| 1
    //| 2
    //| 3
    //| 5
    //| 8
    //| 13
    //| 21
    //| 34
Previous5. [Exercise] Scala Basics, Part 2Next7. [Exercise] Functions in Scala

Last updated 6 years ago