Commit bbc24192 authored by 박준형's avatar 박준형

Update perf.md

parent 9eeb750f
spark.conf.set("spark.sql.files.maxPartitionBytes", 1024 * (1024 * 256))
val df = spark.read.option("header", "true")
val df = spark.read.option("header", "true")
.option("io.compression.codecs", "nl.basjes.hadoop.io.compress.SplittableGzipCodec")
.schema(schema).csv(fileName)
\ No newline at end of file
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment