Processing nested json dynamically in PySpark (databricks)

 Below youtube video provides excellent way to process complex json dynamically in PySpark (databricks)

Corresponding code is in github

https://github.com/raveendratal/ravi_azureadbadf/blob/main/azure_realtime_scenarios/dynamic_json_process.ipynb