Dealing With Excel Data in PySpark

Have you ever asked yourself, "how do I read in 10,000 Excel files and process them using Spark?" I hope sounds like a terrible task...but in case you have, it just so happens I might have an approach your interested in.

General Approach

PySpark does not …