Learning is an essential part of life, and attending SQL Saturday ATL is a great way to learn about different topics. In my experience, I was able to learn about DataOps, Gerilumn, Data Governance, and Machine Learning.
During my time at SQL Saturday, I attended six sessions, and I'd like to share some of the key takeaways from each of them.
Session 1: Practical Use Cases for Composite Models by Kevin Arnold
In this session, I learned about Power BI and its different aspects. The main goal of composite models is to enrich, extend, and overview. I also learned about the four main modes to connect to data sources, which are import, direct query, mixed, and live connection. The main goal of composite modes is to extend, enrich, and overview. We also discussed some use cases and learned about personalized visuals.
Session 2: Data Pipeline Architecture: Key Design Principles & Considerations by Jean Joseph
Jean Joseph's session was informative and interesting. We discussed what a data pipeline is and its components, types, and use cases. A data pipeline is a method where raw data is ingested from various data sources and then ported to a data store, like a data lake or data warehouse, for analysis. We also learned about the modern data processing architectural pattern and two different approaches to Lambda architecture. Moreover, we learned about the Kappa architecture, which processes data in real-time for analytical and transactional workloads using an event-driven approach and a unified technology stack.
Session 3: NextGen AI: Deep Reinforcement Learning & Machine Teaching for Autonomous Systems by Barkha Herman
Barkha Herman discussed deep reinforcement learning, which reminded me of AWS DeepRacer. We learned about the four main different problems or classification categories AI has come so far, which are classification problem, prediction, anomaly detection, and clustering problem. Additionally, we learned about the Bonsai Tree project, which is a service from Microsoft that helps optimize manufacturing yield, chemical process optimization, building energy management, logistics and supply chain optimization, discrete and process manufacturing, CPG/retail, and energy transportation.
Go support Barkha :)
Session 4: DataOps 101 – A Better Way to Develop and Deliver Data Analytics by John Kerski
In John Kerski's session, we went through an amazing example of a data analyst between their boss and how DataOps is important. DataOps incorporates several methodologies and concepts such as DevOps, Agile, and Lean Manufacturing. It emphasizes continuous integration and deployment, promotes collaboration between development and operations teams, and follows Agile principles of self-organizing teams and delivering value quickly. DataOps also simplifies and standardizes processes, increases automation, and treats data and its transformations as a product on a manufacturing line, requiring constant monitoring of data quality at each step. We also learned why it matters to make it reproducible, learn or embrace Git, monitor quality and performance, catch errors before clients do, and reduce heroism and avoid burnout.
Session 5: Getting Started with Graph Databases and Graph Query Languages by Taylor Riggan
In Taylor Riggan's session, we went through a crash course in graph (database)tech and how to get started with Jupyter notebook. We learned what a graph is, how it is purpose-built to store and navigate relationships, and how nodes represent real-world objects, while edges store relationships between objects. We also learned that properties and labels can be added to nodes and edges, and that there are different types of graphs, including directed and undirected graphs.
Session 6 : Share Power BI Reports in Your Organization the Right Way by Daniel Glenn
Daniel Glenn discussed how to share Power BI reports in an organization in the right way. He covered various methods of sharing data, including group, specific user, workspaces, apps, embed, publish to web, and Teams. The session was informative and engaging, and Daniel even asked fun questions about controversial topics like pineapple pizza and tomatoes on hotdogs.
And that's a wrap, folks! My experience at SQL Saturday was amazing. I had a blast attending various sessions on topics like DataOps, Gerilumn, Data Governance, Machine Learning, and more. But that's not all, I also got lucky enough to win not one but two raffles! Thank you Sponsors and volunteers for a great event! :)
