Data Science Wire

Starting out on Databricks

Reddit r/databricks2d4 min read

Hi everyone! I’m a software engineer who moved into data engineering around a year ago and have been learning and working with Databricks. So far, I’ve worked on loading data from ADLS and external locations, basic PySpark transformations, implementing the medallion architecture using notebooks and SQL, and scheduling workflows using Databricks Jobs. I feel like I’ve covered the basics but still have a lot to learn, especially when it comes to how things are done in real-world projects. I’d love to connect with people working with Databricks and learn more about industry best practices, the ar

Read the full story at Reddit r/databricks →

More in Data Engineering