Skip to content

Add Azure SQL and Microsoft Fabric Lakehouse data connectors #245

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
Copilot wants to merge 4 commits into
base: main
Choose a base branch
from
+2,021 −3
Draft

Add Azure SQL and Microsoft Fabric Lakehouse data connectors #245

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a7a35d9
Initial plan
Copilot Mar 4, 2026
4b7364a
Add Azure SQL and Fabric Lakehouse data connectors
Copilot Mar 4, 2026
f85530b
Remove egg-info build artifacts and update .gitignore
Copilot Mar 4, 2026
fe48424
Add unit tests for Azure SQL and Fabric Lakehouse loaders (simulated …
Copilot Mar 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@
build/
dist/
experiment_data/
*.egg-info/

## Ignore Visual Studio temporary files, build results, and
## files generated by popular Visual Studio add-ons.
Expand Down
2 changes: 2 additions & 0 deletions py-src/data_formulator/data_loader/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ The UI uses the same loaders for connection setup, table listing, and ingestion
- **`MySQLDataLoader`**: MySQL (connectorx)
- **`PostgreSQLDataLoader`**: PostgreSQL (connectorx)
- **`MSSQLDataLoader`**: Microsoft SQL Server (connectorx)
- **`AzureSQLDataLoader`**: Azure SQL Database / Managed Instance — SQL auth (connectorx) or Entra ID (pyodbc + AAD token)
- **`FabricLakehouseDataLoader`**: Microsoft Fabric Lakehouse / Data Warehouse SQL Analytics Endpoint — Entra ID only (pyodbc + AAD token)
- **`S3DataLoader`**: Amazon S3 files (CSV, Parquet, JSON) via PyArrow S3 filesystem
- **`AzureBlobDataLoader`**: Azure Blob Storage via PyArrow
- **`MongoDBDataLoader`**: MongoDB
Expand Down
10 changes: 8 additions & 2 deletions py-src/data_formulator/data_loader/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,8 @@
from data_formulator.data_loader.mongodb_data_loader import MongoDBDataLoader
from data_formulator.data_loader.bigquery_data_loader import BigQueryDataLoader
from data_formulator.data_loader.athena_data_loader import AthenaDataLoader
from data_formulator.data_loader.azure_sql_data_loader import AzureSQLDataLoader
from data_formulator.data_loader.fabric_lakehouse_data_loader import FabricLakehouseDataLoader

DATA_LOADERS = {
"mysql": MySQLDataLoader,
Expand All @@ -18,7 +20,9 @@
"postgresql": PostgreSQLDataLoader,
"mongodb": MongoDBDataLoader,
"bigquery": BigQueryDataLoader,
"athena": AthenaDataLoader
"athena": AthenaDataLoader,
"azure_sql": AzureSQLDataLoader,
"fabric_lakehouse": FabricLakehouseDataLoader,
}

__all__ = [
Expand All @@ -31,5 +35,7 @@
"PostgreSQLDataLoader",
"MongoDBDataLoader",
"BigQueryDataLoader",
"AthenaDataLoader",
"AthenaDataLoader",
"AzureSQLDataLoader",
"FabricLakehouseDataLoader",
"DATA_LOADERS"]
Loading