For this technical session, we look at a data engineering process and the related cloud technologies that are needed to build a data pipeline from CSV files to data visualization for Big Data scenarios for real use cases.
Some of the technologies that we will be covering:
- Data Lakes
- Data Warehouse
- Data Analysis and Visualization
- Python
- Jupyter Notebook
- SQL
ozkary.com
VP of product development
Oscar Garcia is a Principal Software Engineer and VP of Product Development with a distinguished career in the technology industry. As a Microsoft MVP and certified solutions' developer, Oscar is renowned for his exemplary leadership in crafting cutting-edge, scalable cloud-based solutions tailored to the dynamic health and automobile industries.
Cloud Solutions: Oscar excels in arch…
Oscar Garcia is a Principal Software Engineer and VP of Product Development with a distinguished career in the technology industry. As a Microsoft MVP and certified solutions' developer, Oscar is renowned for his exemplary leadership in crafting cutting-edge, scalable cloud-based solutions tailored to the dynamic health and automobile industries.
Cloud Solutions: Oscar excels in architecting robust cloud solutions using industry-leading platforms such as Google Cloud Platform (GCP) and Microsoft Azure.
Web Development: He is a master at crafting web applications, employing technologies like Node.js, Angular, React, and .NET to deliver seamless and engaging user experiences.
AI Solutions: Oscar has a deep understanding of AI, with expertise in areas such as Text-to-Speech, Chatbots, OpenAI API integration, and machine learning supervised models. His AI solutions enhance user interactions and automate complex processes, making them more efficient and user-friendly.
Collaborative Technologies: Oscar's expertise extends to collaboration and productivity tools such as SharePoint and Power Platform, facilitating efficient workflows and communication.
Firebase & GitHub: He's well-versed in Firebase for rapid app development and GitHub for version control and collaboration within development teams.
Data Engineering: Oscar is a proficient data engineer, leveraging technologies like Apache Spark, Apache Kafka, SQL, and Python to create data-driven solutions that drive informed decision-making. His skill set extends to Azure Data Factory, empowering data integration and ETL processes in the Azure ecosystem.
Oscar's commitment to best practices is evident in his agile methodology implementation, which has consistently resulted in the successful design and deployment of web applications, microservices, serverless architectures, and AI solutions. His work not only enhances user interactions but also automates critical processes, driving efficiency and innovation.
For the latest insights and updates on technology trends and solutions, you can follow Oscar on Twitter @ozkary or explore his comprehensive blog at ozkary.com.
ozkary.com
VP of product development
Oscar Garcia is a Principal Software Engineer and VP of Product Development with a distinguished career in the technology industry. As a Microsoft MVP and certified solutions' developer, Oscar is renowned for his exemplary leadership in crafting cutting-edge, scalable cloud-based solutions tailored to the dynamic health and automobile industries.
Cloud Solutions: Oscar excels in architecting robust cloud solutions using industry-leading platforms such as Google Cloud Platform (GCP) and Microsoft Azure.
Web Development: He is a master at crafting web applications, employing technologies like Node.js, Angular, React, and .NET to deliver seamless and engaging user experiences.
AI Solutions: Oscar has a deep understanding of AI, with expertise in areas such as Text-to-Speech, Chatbots, OpenAI API integration, and machine learning supervised models. His AI solutions enhance user interactions and automate complex processes, making them more efficient and user-friendly.
Collaborative Technologies: Oscar's expertise extends to collaboration and productivity tools such as SharePoint and Power Platform, facilitating efficient workflows and communication.
Firebase & GitHub: He's well-versed in Firebase for rapid app development and GitHub for version control and collaboration within development teams.
Data Engineering: Oscar is a proficient data engineer, leveraging technologies like Apache Spark, Apache Kafka, SQL, and Python to create data-driven solutions that drive informed decision-making. His skill set extends to Azure Data Factory, empowering data integration and ETL processes in the Azure ecosystem.
Oscar's commitment to best practices is evident in his agile methodology implementation, which has consistently resulted in the successful design and deployment of web applications, microservices, serverless architectures, and AI solutions. His work not only enhances user interactions but also automates critical processes, driving efficiency and innovation.
For the latest insights and updates on technology trends and solutions, you can follow Oscar on Twitter @ozkary or explore his comprehensive blog at ozkary.com.
