Write unit test for prevailing code in Python Pyspark SQL and configure tests in Pycharm
What you will learn
How to write unit test for prevailing code in Python Pyspark SQL
How to use Excel power queries
How to setup Pycharm, venv, unit testing, coverage for testing
How to write code for smaller and bigger function class task workflows
Why take this course?
Writing Tests for SimEng – Code conversion concepts
Write unit test for prevailing code in Python Pyspark SQL and configure tests in Pycharm
Get Instant Notification of New Courses on our Telegram channel.
Noteβ Make sure your ππππ¦π² cart has only this course you're going to enroll it now, Remove all other courses from the ππππ¦π² cart before Enrolling!
What you will learn:
- How to write unit test for prevailing code in Python Pyspark SQL
- How to use Excel power queries
- How to setup Pycharm, venv, unit testing, coverage for testing
- How to write code for smaller and bigger function class task workflows
- How to setup correct venv locally
- Intro to code release process
- Setting up local env variables
Topics:
- In Excel power queries we use mostly group by and join on small data to check our results and share with seniors.
- We can create a simpler notebook of the same logic of the code
- A lot of type the errors are due to Local Spark sessions which can be created in many many ways, but if we want to create spark sql views which uses hive then we have to install a hadoop and spard by downloading them.
- Debugging and creating break points and then using step into / step over to generate the output and match or save it with excel
- Making sure we mimic spark from older tests because otherwise we can get error in Jenkins build
English
language