Smart Associates Product

Smart Data Frameworks

A database migration and ELT development platform. Migrate between virtually any database platform, build and manage reusable ELT logic, and keep source and target in continuous sync — delivered as a self-contained virtual appliance.

A Migration Platform, Not Just a Migration Script

Moving a database from one platform to another is one of the most risky, labour-intensive projects a data team can undertake. Done manually, it involves weeks of schema conversion, data type mapping, ELT rewriting, testing, and co-ordinated cutover — with every step dependent on specialist knowledge that most teams need to hire in.

Smart Data Frameworks automates the repeatable parts of this process. It ships as a flatpack virtual machine that you deploy in your own environment. It connects to your source and target databases via ODBC, provides a browser-based GUI for all migration and development tasks, and includes a CLI for scripted and scheduled operations.

SDF covers the full migration lifecycle: initial schema conversion, bulk data load, ongoing delta synchronisation, flat file loading, ELT code development, and controlled promotion of code between environments. It also supports Teradata SQL syntax compatibility, which simplifies workloads for teams migrating away from Teradata.

What SDF Handles
Schema Conversion & Migration
Automated DDL conversion and bulk data migration between any supported platforms
Delta Synchronisation
Keep source and target in continuous sync after the initial migration
ELT Code Development
Template-driven generation of ELT and data quality detection logic
Flat File Loading
Define file layouts and run continuous loading pipelines from structured files
Release Management
Controlled promotion of code and database objects between dev, test, and production

What SDF Provides

Automated Database Conversion & Migration Wizard

Guides you through the end-to-end process of converting and migrating a database schema from one platform to another. Handles DDL conversion, data type mapping, and the orchestration of bulk data load — with reconciliation to verify source and target are in agreement on completion.

Web Browser-Based Database Explorer

A full database browser and SQL query tool delivered entirely in the browser. Connect to any ODBC-accessible database, explore schemas, tables, and column definitions, and run SQL directly — without installing client software on each user's machine.

File Layout Definition & Continuous Loading Wizard

Define the layout of structured flat files (delimited, fixed-width) and configure them to load continuously into target database tables. Handles the ongoing ingestion of file-based data sources as part of a broader migration or integration pipeline.

Integrated Release Management

Manage and promote database objects, ELT code, and configuration between development, test, and production environments in a controlled, auditable way. Reduces the risk of inconsistent or untested changes reaching production and provides a clear record of what was deployed and when.

Customisable Code Template-Driven Development

Automatically generate ELT logic and data quality detection code from a library of customisable templates. Rather than hand-coding transformations for each table, templates enforce consistency, reduce errors, and dramatically accelerate ELT development across large schemas.

Parameter Substitution for Template Reusability

Templates are fully parameterised — the same template can generate correct ELT code for hundreds of different tables, schemas, or target environments simply by varying the parameters. This keeps the template library small and maintainable whilst scaling to large, complex migrations.

Connects to Virtually Any Database Platform

SDF connects source and target databases via ODBC, which means it works with any platform that provides an ODBC driver. Supported platforms include:

IBM Netezza / PDA Snowflake Amazon Redshift Yellowbrick Oracle SQL Server Teradata MySQL Greenplum PostgreSQL Google Bigtable IBM Db2

SDF also supports Teradata SQL syntax compatibility, simplifying migration for teams moving Teradata workloads to a new platform.

Built for the People Who Do the Migration Work

DBAs and Migration Architects

The Migration Wizard and Database Explorer give DBAs the tools to plan, execute, and validate database migrations at the schema and data level — with reconciliation built in so nothing gets missed.

Data Engineers

The code template system and flat file loading wizard significantly reduce the manual ELT coding required during a migration. Templates enforce consistency across hundreds of tables and generate quality detection logic automatically.

Release and Delivery Teams

Integrated Release Management gives teams a controlled, auditable mechanism for promoting database objects and ELT code through dev, test, and production — without ad-hoc scripts or manual co-ordination.

See SDF on Your Migration

Tell us about the platforms you are migrating between and we will show you how SDF handles the conversion, loading, and synchronisation.

Request a Demo