Spark: Date Arithmetic with Multiple Columns
Say you have a timestamp column created_at, and an integer column number that represents a number of weeks, how do you use the date_add function to calculate...
Recent Posts
Spark: Count number of duplicate rows
To count the number of duplicate rows in a pyspark DataFrame, you want to groupBy() all the columns and count(), then select the sum of the counts for the ro...
Mac: Sync with time server (Mojave)
To check and update your system time in macos Mojave:
Docker: Set Timezone
To set which timezone your docker container should use, add the following to your Dockerfile:
Docker: Start Container as Root User
When sudo is not available in container, you can jump into a running container as root user using one of these commands: