Nix: Change Default Shell For A User
You can change the default shell program for a particular unix user with the chsh command. Just tell it what shell program you want to use (e.g. bash or zsh)...
Recent Posts
Nix: Cat A File With Line Numbers
You can quickly view a file using cat
Spark: Orderby Partitioning
Remember that orderBy uses the number of partitions specified by spark.conf.get("spark.sql.shuffle.partitions"). The default for this is 200. Can change manu...
SHAttered
Awesome work to demonstrate how to deliberately cause a SHA-1 collision.
Spark: Materializing and Unpersisting Cache
If you want to reuse a dataframe df without having to recreate it, you can use df.cache() to tell Spark to keep the dataframe in memory.