Add new file

9eeb750f · 박준형 · cadd97be · 9eeb750f
Commit 9eeb750f authored Jul 20, 2022 by 박준형
Show whitespace changes
Inline Side-by-side

Showing with 4 additions and 0 deletions

perf.md perf.md +4 -0

No files found.
--- a/perf.md
+++ b/perf.md
+spark.conf.set("spark.sql.files.maxPartitionBytes", 1024 * (1024 * 256))
+    val df = spark.read.option("header", "true")
+      .option("io.compression.codecs", "nl.basjes.hadoop.io.compress.SplittableGzipCodec")
+      .schema(schema).csv(fileName)
\ No newline at end of file