Heran Lin
Heran is focused on building the next generation of data infrastructure able to meet the demands of AI at scale. He holds a master’s degree in computational data science from Carnegie Mellon University and a bachelor’s degree in computer software from Tsinghua University.
Posts by Heran Lin
Release
Sail 0.7: Stateless Compute, Durable Job State
Engineering
The Lakehouse Format Is an Engine Contract
Engineering
How Sail Compares to Photon and Other Spark Accelerators
Release
Sail 0.6: Arrow, End to End
Engineering
Agent Skills for Spark Workloads
Release
Sail 0.5: Resilient and Observable Distributed Execution
Engineering
Spark’s Python Problem and How Sail Solves It
Engineering
How Sail Utilizes and Extends Apache DataFusion
Engineering
Sail, the Last Piece of the Composable Data Stack
Release
Sail 0.4: Native Apache Iceberg Support
Engineering
Sail Turns One
Release
Sail 0.3: Long Live Spark
Release
Sail 0.3.2: Start the Journey from Your Lakehouse
Release
Announcing Sail 0.2.6
Engineering
Sail MCP Server: Spark Analytics for LLM Agents
Engineering
Writing a Rust SQL Parser in One Week
Engineering
Beyond the JVM: How Rust is Redefining Big Data for the AI Era
Release
Sail 0.2.1: Enhanced UDF Support
Engineering
Why It’s Possible Now: Sail 0.2 and the Evolution of Distributed Compute Frameworks
Engineering
Sail 0.2 and the Future of Distributed Processing
Engineering
Introducing Sail Enterprise Support
Engineering
A Sail Recipe: Tackling an Out-of-Control Redshift Bill
Release
The First PySail Release
Benchmarks