top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

In Scala If more than 22 fields in case class then How Spark process the data?

+1 vote
360 views
In Scala If more than 22 fields in case class then How Spark process the data?
posted Nov 22, 2016 by Shyam

Share this question
Facebook Share Button Twitter Share Button LinkedIn Share Button

1 Answer

+1 vote

If Case class doesn’t work properly, data loaded as an RDD or the row objects. Schema created separately using StructType (table) and StructFiled (field) objects. Schema is applied to the row RDD to create a DataFrame.

answer Nov 23, 2016 by Karthick.c
...