← First Pair Library

Next: Reader Guide: How This Book Builds

Sail Rust Book

The Rust, Arrow, and DataFusion Guide

Alexy Khrabrov ∈ LakeSail Team

2026-07-14

Contents

1 Reader Guide: How This Book Builds
2 Chapter 1: Architecture Overview
3 Chapter 2: Rust Foundations in Sail
4 Chapter 3: Spark Connect
5 Chapter 4: PySpark and pysail
6 Chapter 5: Apache Arrow
7 Chapter 6: Apache DataFusion
8 Chapter 7: From Physical Plan To Job Graph
9 Chapter 8: Drivers, Workers, Tasks, And Streams
10 Chapter 9: Shuffle And Data Movement
11 Chapter 10: The Sail Spec And Plan Resolver
12 Chapter 11: Functions, UDFs, And Codecs
13 Chapter 12: Catalogs, Lakehouse Tables, And File Formats
14 Chapter 13: Extension Architecture: From Proposal To Design
15 Chapter 14: Arrow Flight SQL
16 Chapter 15: Custom Nodes And Optimizers
17 Chapter 16: Local And Streaming Execution
18 Chapter 17: Testing Spark Compatibility
19 Chapter 18: Feature Playbooks
20 Chapter 19: Roadmap And Codebase Navigation
21 Chapter 20: Current Codebase Edition