DataFrame transformations and optimization
The lesson covers transformation methods including select() for keeping columns, drop() for removing columns, and distinct()/dropDuplicates() for removing duplicates. It also explains .cache() for in-memory processing of small datasets and materialization points like write and display.
