The Magic of PySpark
Saturday 16th of November, the Python Barcelona Association organised PyDay, a free one day event where you could attend talks and workshops related to Python. Affectv was its coffee sponsor, and (aside from being an organiser) I gave a workshop about PySpark to the community.
The event (which took place in the city center, at the University of Barcelona Mathematics faculty) was a success, with more than 200 attendees and 4 parallel tracks, where one was a full-day session of Django Girls. And as an avid coffee drinker, I can say the coffee was good.
The workshop consisted of two parts:
- First a set of slides (based on 2 previous talks I have given) explaining what Spark is and how it works
- Then, an interactive Jupyter notebook where the basics of the PySpark API are introduced
You can find the workshop (slides and notebook) in this repository. If you have any questions, feel free to open an issue in the repository.