Data Engineering Contractor
she/her
Emily loves to be involved in a range of things from blowing up circuits to riding horses to rockets. She's an Electrical Engineer by trade but has found herself working in the realms of software and data science. With a passion for both hardware and software, she hopes to combine the two to make technology smarter and more sustainable. Currently, she is helping various kiwi startups build beautiful yet affordable data platforms.
Solar farms are part of the answer to a renewable energy future. These massive solar arrays take power from the sun and safely deliver it to the grid to then be used by us, the consumer. Efficiency gains of even 1% can make a big difference in the feasibility of solar, so having rock solid analytics at scale is a necessity. More and more farms are being built and therefore the cost to get said analytics is also important. Join Emily as she walks through the constraints of the solar industry and how she built a data platform for solar farms on a budget using almost entirely open-source tools. In some parts real-time matters, in others, a one hour lag is acceptable - how can we use the best of both batch and streaming worlds to keep pipelines performant but also cheap? She'll focus on Apache Iceberg, an open table format, as well as touch on Victoria Metrics and DuckDB.
