Looking for data in all the right places...

Principal Data Scientist at TriNet – Planet discoverer, researcher, developer, geek.

Spark: Orderby Partitioning

February 27, 2017 less than 1 minute read

The spark.sql.shuffle.partitions configuration option

February 23, 2017 less than 1 minute read

Deliberately cause a SHA-1 collision

February 14, 2017 less than 1 minute read

Optimize your use of Spark DataFrames

February 10, 2017 less than 1 minute read

Top tips

February 7, 2017 less than 1 minute read

Mathematical genius resides within every one of us