Jonathan Neo
Senior Data Platform Engineer at Canva
Jonathan is a Data Platform Engineer at Canva where he is building and scaling one of Australia's largest data platforms, housing over 25PB in storage, processing 10K data workloads, and supporting 3K users. Jonathan founded Data Engineer Camp, where he has helped over 100 working professionals transition into data engineering roles at companies like Atlassian, Zendesk, and Apple.
Sessions
Blueprints for Scaling: Practical Steps for Scaling Your Data Platform to Handle Exponential Growth
Data platforms come in all shapes and sizes. There’s no one-size-fits-all. As a company grows, the data platform you’ve built will start experiencing bottlenecks. What should you do when you start experiencing bottlenecks? How do you scale your data platform to cope with exponential growth? The speaker answers these questions by drawing upon his experience from building and scaling some of the world’s largest data platforms, housing over 10PB in storage, 10K data workloads, and 3K users. The speaker will discuss 6 practical steps to scale data platforms in detail, and provide real-world examples from the data platforms he’s built at leading tech companies: 1. Decentralize the platform and empower your teams 2. Define and provide shared platform services 3. Define and provide composable primitives and paved roads 4. Enforce policies 5. Nudge theory 6. Provide education and training
Starts: 2:10 PM
Ends: 2:40 PM