SmartTableSync 0.5.1
See the version list below for details.
dotnet add package SmartTableSync --version 0.5.1
NuGet\Install-Package SmartTableSync -Version 0.5.1
<PackageReference Include="SmartTableSync" Version="0.5.1" />
<PackageVersion Include="SmartTableSync" Version="0.5.1" />
<PackageReference Include="SmartTableSync" />
paket add SmartTableSync --version 0.5.1
#r "nuget: SmartTableSync, 0.5.1"
#:package SmartTableSync@0.5.1
#addin nuget:?package=SmartTableSync&version=0.5.1
#tool nuget:?package=SmartTableSync&version=0.5.1
SmartTableSync
A self-configuring .NET engine that keeps tables synchronized from one SQL database to another (parent to child). Give it table names: it inspects each table's schema, picks how to detect changes and how to merge them, and keeps the child up to date on the schedule your host chooses.
Built for Azure SQL Database, where it runs in production, and works with Azure SQL Managed Instance and SQL Server (on-premises or in a VM) in any combination.
What it does
- Syncs the tables you list, one way: inserts, updates and deletes.
- Chooses per table how to find changed rows: SQL Server Change Tracking, a
rowversioncolumn, a timestamp column, or a full re-scan for small tables. - Copies a new table in full once, then only what changed, and resumes where it stopped.
- Needs no DDL rights at run time and signs in with managed identities or any SQL Server sign-in.
- Notices schema changes in the parent; in Auto mode it adds new columns to the child by itself.
Install
dotnet add package SmartTableSync
That's the only package you need: it includes every sign-in method, from SQL logins and Windows
authentication to managed identities and other Microsoft Entra methods
(Authentication=Active Directory ... in the connection string).
Use it
Register the engine and run it on your own schedule, here every 5 minutes in a background service:
using SmartTableSync.Abstractions;
using SmartTableSync.Hosting;
var builder = Host.CreateApplicationBuilder(args);
builder.Services.AddSmartTableSync();
builder.Services.AddHostedService<SyncWorker>();
builder.Build().Run();
public sealed class SyncWorker(ISyncOrchestrator orchestrator) : BackgroundService
{
protected override async Task ExecuteAsync(CancellationToken stoppingToken)
{
using var timer = new PeriodicTimer(TimeSpan.FromMinutes(5));
do
{
await orchestrator.RunAsync(stoppingToken);
}
while (await timer.WaitForNextTickAsync(stoppingToken));
}
}
appsettings.json:
{
"ParentDbConnectionString": "Server=tcp:myserver.database.windows.net,1433;Database=ParentDb;Authentication=Active Directory Managed Identity;User Id=<client id>;Encrypt=True",
"ChildDbConnectionString": "Server=tcp:myserver.database.windows.net,1433;Database=ChildDb;Authentication=Active Directory Managed Identity;User Id=<client id>;Encrypt=True",
"SmartTableSync": {
"TableList": "Product,Customer,sales.Order",
"Mode": "Manual"
}
}
The child database needs a table, a table type and a merge procedure for every synced table.
In Manual mode (the default) you create them from the scripts of the
SmartTableSync.Scaffold tool; in Auto
mode the engine creates them itself with a separate provisioning connection
(ChildProvisioningConnectionString).
Hangfire, Quartz.NET and other hosts work the same way: call ISyncOrchestrator.RunAsync from
your scheduler. Overlapping runs are safe, also across several instances.
How changes are found
| Strategy | Used when | Deletes reach the child |
|---|---|---|
| Change Tracking | SQL Server Change Tracking is on for the table | on every run |
| RowVersion | the table has a rowversion column |
at the delete check, hourly by default |
| Timestamp | the table has a UTC datetime column updated on every change (default LastUpdate) |
at the delete check |
| Full re-scan | none of the above, and the table has up to 50,000 rows | at the delete check |
Documentation
- Overview and guides
- Manual mode, step by step
- Auto mode, step by step
- Run it in your own app: background service, Hangfire, Quartz.NET
- Every setting, with examples
- Identities, rights and troubleshooting
- How each strategy finds changes
- Known limitations
- Changelog
License
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net10.0
- Microsoft.Data.SqlClient (>= 7.0.2)
- Microsoft.Data.SqlClient.Extensions.Azure (>= 7.0.2)
- Microsoft.Extensions.Configuration.Abstractions (>= 10.0.3)
- Microsoft.Extensions.DependencyInjection.Abstractions (>= 10.0.3)
- Microsoft.Extensions.Options (>= 10.0.3)
- System.Security.Cryptography.Pkcs (>= 10.0.13)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.
The quick start now comes from NuGet: a new template package creates the Azure Function and the
deploy script as a project of your own, so there's no need to clone the repository. The library
and the scaffold tool are unchanged apart from the version.
### Added
- **SmartTableSync.Templates**, a `dotnet new` template package. `dotnet new install
SmartTableSync.Templates`, then `dotnet new smarttablesync-azure -n MySync`, creates a project
of your own with the Azure Function (using the SmartTableSync package), the quick start script
and its Terraform, and the scaffold tool as a local tool, all in the template's version. The
quick start no longer needs a clone of the repository.
### Changed
- `quickstart/deploy.ps1` runs the scaffold tool from NuGet (the project's
`.config/dotnet-tools.json`) when it runs in a project created from the template, and from
source in the repository, as before.
- The Manual mode guide and the setup guide install the scaffold tool from NuGet instead of running
it from the repository.
### Upgrading
Nothing to change: no new settings, rights or schema scripts. Update with
`dotnet add package SmartTableSync` and `dotnet tool update --global SmartTableSync.Scaffold`.
### Tested
- Unit and integration tests (298 and 72) pass.
- A project created from the template builds against the release's SmartTableSync package with no
warnings, and runs the release's scaffold tool through its tool manifest; the release workflow
checks this before publishing.
- The quick start script's scaffold step runs both in a project created from the template and in
the repository.
Full changelog: https://github.com/Sidorus/SmartTableSync/blob/main/CHANGELOG.md