Skip to content
lakeFS Documentation
Data Science Workflow Tutorial
Join us on Slack
Initializing search
treeverse/lakeFS
lakeFS Documentation
treeverse/lakeFS
Welcome to lakeFS
Quickstart
Quickstart
Overview
1️⃣ Run lakeFS
2️⃣ Query the data
3️⃣ Create a branch
4️⃣ Commit and Merge
5️⃣ Roll back Changes
6️⃣ Using Actions and Hooks
7️⃣ Work with data locally
➡️ Learn more
Use Cases
Use Cases
CI/CD for Data Lakes
ETL Testing Environment
Reproducibility
User Guides
User Guides
Installing
Installing
Overview
AWS
Azure
GCP
On-Premises
Upgrading
Work with Data locally
Sizing Guide
Data Management
Data Management
Git-Like Versioning
Git-Like Versioning
Pull Requests
Branch Protection
Rollback & Revert
Merge Strategies
Import & Export Data
Import & Export Data
Importing Data
Export Data
Copying data to/from lakeFS
Data Catalogs Exports
lakeFS Mount
Actions and Hooks
Actions and Hooks
Overview
Airflow Hooks
Lua Hooks
Webhooks
Garbage Collection
Garbage Collection
Overview
Managed Garbage Collection
Standalone Garbage Collection
Metadata search
Multiple Storage Backends
Transactional Mirroring
Backup and Restore
Advanced Operations
Advanced Operations
Private Link
S3 Virtual-host addressing
Monitoring & Auditing
Monitoring & Auditing
Monitoring using Prometheus
Auditing
Migrating away
lakeFS Enterprise 🚀
lakeFS Enterprise 🚀
Features
lakeFS Cloud
On-Premises
On-Premises
Quickstart
Installation
Migrating from lakeFS OSS
Upgrading
Architecture
Troubleshooting
Configuration Reference
Integrations
Integrations
Data Processing & Compute
Data Processing & Compute
Apache Spark
Apache Iceberg
Apache Hive
Presto / Trino
Dremio
Databricks
Cloudera
DuckDB
Delta Lake
Amazon Athena
Apache Kafka
ML & AI
ML & AI
Amazon SageMaker
Vertex AI
Red Hat OpenShift AI
HuggingFace Datasets
MLflow
Kubeflow
Catalogs & Metadata
Catalogs & Metadata
Iceberg REST Catalog
Glue Data Catalog
Glue / Hive metastore
Unity Catalog
Orchestration & ETL
Orchestration & ETL
Apache Airflow
Airbyte
Dev & Tools
Dev & Tools
Python
Python
Overview
Getting Started
High-Level SDK
High-Level SDK
Overview
Quickstart
Repositories
Branches & Commits
Objects & I/O
Imports & Exports
Transactions
Advanced Features
Generated SDK
Generated SDK
Overview
API Reference
Examples
Direct Access
lakefs-spec
lakefs-spec
Overview
Filesystem API
Integrations
Transactions
Boto3
Boto3
Overview
Configuration
S3 Operations
S3 Router
Tutorials
Tutorials
Overview
Data Science Workflow
ETL Pipeline
ML Experiment Tracking
Reference
Reference
Overview
API Comparison
Best Practices
Troubleshooting
Changelog
AWS CLI
Git
R
Concepts
Concepts
Architecture
Model
Data Structure
Performance Best Practices
Mount Write Mode Semantics
Internals
Internals
Versioning Internals
Database structure
FAQ
Glossary
Security
Security
Overview
Authentication
Authentication
Authentication
Single Sign On (SSO)
AWS IAM Roles
Remote Authenticator
Short-Lived Tokens (STS)
SCIM
Authorization
Authorization
Role-Based Access Control (RBAC)
Access Control Lists (ACLs)
ACL Server Implementation
Presigned URLs
Reference
Reference
lakeFS API
lakectl (lakeFS command-line tool)
lakeFS Server Configuration
S3 Gateway API
Spark Client
Authorization API
Community
Community
About the lakeFS Project
Contributing
Contributing
Code
Documentation
Data Science Workflow Tutorial
¶
Placeholder content for data science workflow tutorial.