Recent Posts

(TIL) Spark: Orderby Partitioning

less than 1 minute read

Remember that orderBy uses the number of partitions specified by spark.conf.get("spark.sql.shuffle.partitions"). The default for this is 200. Can change manu...

SHAttered

less than 1 minute read

Awesome work to demonstrate how to deliberately cause a SHA-1 collision.