DataEngBytes 2024
Juan Sequeda

Dr Juan Sequeda

Dr. Juan Sequeda is the Principal Scientist at data.world. He joined through the acquisition of Capsenta, a company he founded as a spin-off from his ...

Designing and Building Enterprise Knowledge Graphs

Locations: Sydney
This workshop is a guide to designing and building knowledge graphs from enterprise relational databases in practice. It presents a principle framework centered on mapping patterns to connect relational databases with knowledge graphs, the roles within an organization responsible for the knowledge graph, and the process that combines data and people. The content of this book is applicable to knowledge graphs being built either with property graph or RDF graph technologies. Knowledge graphs are fulfilling the vision of creating intelligent systems that integrate knowledge and data at large scale. Tech giants have adopted knowledge graphs for the foundation of next-generation enterprise data and metadata management, search, recommendation, analytics, intelligent agents, and more. We are now observing an increasing number of enterprises that seek to adopt knowledge graphs to develop a competitive edge. In order for enterprises to design and build knowledge graphs, they need to understand the critical data stored in relational databases. How can enterprises successfully adopt knowledge graphs to integrate data and knowledge, without boiling the ocean? This book provides the answers.

StartTime: 9 am

EndTime: 12.30 pm

Zach Wilson

Zach Wilson

I have led teams of data engineers and software engineers at Airbnb, Facebook, and Netflix. My next goal is to upskill as many data knowledge workers ...

Compressing a 100 TB data lake into 5 TBs with Iceberg and Parquet

Locations: SydneyPerth
In this workshop, we explore the fundamental concepts essential for effective data modeling and database management. We dive into understanding your data consumer, the distinctions between OLTP and OLAP data modeling, the principles of Cumulative Table design, and the tradeoff between compactness and usability. We also address the challenges of temporal cardinality explosion and the potential pitfalls of run-length encoding compression. By the end of this lecture, you will have a strong foundation in the key concepts of data modeling and be prepared to apply these principles in practice.

StartTime: 9 am

EndTime: 12.30 pm

Nelly Sattari

Nelly Sattari

Nelly Sattari is a Senior Engineering Manager at Atlassian leading Platform teams. Nelly is a Microsoft MVP in Cloud Native, community leader, public ...

Unleash Your Tech Leading Potential

Locations: SydneyMelbourneAuckland
New or aspiring tech leaders are often skilled engineers who lack experience in managing teams. Even seasoned leaders can face new challenges as organizations evolve and teams become more distributed. Training helps them build essential leadership skills to guide technical teams. Just as engineers stay updated on industry trends, tech leaders need to learn how to effectively empower their teams and help engineers add value to the business. In this one-day workshop, we will focus on key aspects of tech leadership: fostering engineers' growth, maintaining team health, building strong and connected teams, balancing workloads and building a performing team.

StartTime: 1 pm

EndTime: 5 pm

Johnny Mirza

Johnny Mirza

Johnny Mirza is a Solution Architect with ClickHouse, working with users across APAC. With over 20 years of background in solutions engineering, he’s ...

Getting started with ClickHouse

Locations: Sydney
This workshop provides a comprehensive introduction to ClickHouse, covering its fundamentals, benefits, and practical applications. Participants will learn about ClickHouse's architecture as a columnar data store, its performance advantages, and its use cases. The course includes hands-on labs for getting started with ClickHouse Cloud, data insertion techniques, query writing, and data modeling. Key topics include table engines, table functions, input formats, and primary key design. Use cases for real-time analytics, business intelligence, machine learning, and log management are also discussed, with actionable implementation steps.

Outcomes:

  • Set up and use ClickHouse Cloud
  • Ingest and Query Data in ClickHouse
  • Model Data for different use cases

StartTime: 1 pm

EndTime: 5 pm