Portrait of Vasanth N, Lead Data Engineer and Architect in Auckland, New Zealand

Hello, I'm Vasanth N.

Data Architect &
Solution Designer

Hands-on Data Architect & Lead Data Engineer with 16+ years' experience across financial services, utilities, and automotive, turning complex business requirements into scalable, reusable data solutions across Snowflake, Databricks, Azure, and AWS.

See my work Auckland, New Zealand
2011 2026
  • WEL Networks (Current)
  • Vaan Consulting (Founder)
  • Ford Motors
  • Bank of America
  • Royal Bank of Canada
  • US Bank & BNY Mellon
Last push vaan-mobile-react-native

Selected work

Work that ships.

Every product has a system behind the screen. Hover a screen, or tap System, to see it.

Energy & Utilities

WEL Utility Platform

Enterprise data platform across Snowflake, Azure Data Lake, Coalesce, FME & Kafka.

  • Snowflake
  • Azure Data Lake
  • Coalesce / dbt
  • FME
  • Kafka
  • Python
data.wel.co.nz
WEL Networks Enterprise Utility Platform: Snowflake, Azure, FME, and Kafka data architecture.
Automotive & IoT

Ford Vehicle Platform

Cloud data platform on Snowflake & Databricks with automated ELT & Kafka.

  • Snowflake
  • Databricks
  • Apache Kafka
  • Airflow
  • Python
  • SQL
telemetry.ford.com
Ford Motors Connected Vehicle Data Platform: Snowflake, Databricks, and Kafka.
Financial Services

Regulated Banking Hub

Governed analytical pipelines across Azure Data Lake, Snowflake & Apache Spark.

  • Snowflake
  • Apache Spark
  • Azure ADLS
  • Python
  • SQL
  • Kimball
analytics.bankofamerica.com
Bank of America Regulated Financial Analytics: Azure Data Lake, Apache Spark, and Snowflake.
Banking Lakehouse

RBC Delta Lakehouse

On-premises to Azure Delta Lakehouse migration with Unity Catalog governance.

  • Azure Databricks
  • Delta Lake
  • Unity Catalog
  • Python
  • SQL
lakehouse.rbc.com
Royal Bank of Canada Delta Lakehouse: Databricks and Unity Catalog.
Cloud Lakehouse

Delta Lakehouse Engine

Multi-cloud real-time lakehouse on Delta Lake, Databricks & Snowflake.

  • Snowflake
  • Databricks
  • Delta Lake
  • dbt
  • Kimball
vaanconsulting.com
Delta Lakehouse: Multi-cloud real-time lakehouse on Delta Lake and Snowflake.
Streaming Pipeline

Streaming Fabric

High-throughput telemetry & financial events processing at scale with Kafka.

  • Apache Kafka
  • Spark Streaming
  • Azure
  • Java
  • Spring
streaming.vaanconsulting.com
Streaming Fabric: High-throughput telemetry and events processing.
Enterprise Migration

Cloud Migration Engine

Automated zero-downtime migration of on-prem databases to Azure & AWS.

  • Azure Synapse
  • AWS S3
  • Terraform
  • Airflow
  • Python
migration.vaanconsulting.com
Cloud Migration Engine: Zero-downtime database migration to cloud lakehouses.
Analytics Hub

Fabric & Snowflake Hub

Governed self-service analytics powering cross-functional BI and enterprise KPIs.

  • Microsoft Fabric
  • Power BI
  • SnowPro
  • DAX
  • Kimball
analytics.vaanconsulting.com
Fabric & Snowflake Analytics Hub: Certified governance and reporting.
Architecture Advisory

FinOps & Governance

Security hardening, access controls, and 30%+ cloud data cost optimization.

  • FinOps
  • NZISM
  • ISO 27001
  • Governance
  • Auditing
governance.vaanconsulting.com
FinOps & Governance: Cloud cost optimization and compliance.

More platforms & systems

Also built.

Core data infrastructure, governance frameworks, and mission-critical payment engines delivered across global enterprises.

Banking Payments

US Bank & BNY Payment

6+ years delivering governed, accurate data extracts for risk and fraud analytics.

  • Oracle SQL
  • Java
  • Cloud ETL
  • Fraud Analytics
payments.cognizant.com
US Bank and BNY Mellon Payment Service: Governed risk and fraud analytics extracts.
Data Governance

Unity Catalog Mesh

Centralized metadata management and fine-grained RBAC across multi-tenant lakehouses.

  • Unity Catalog
  • Delta Lake
  • RBAC
  • Lineage
catalog.enterprise.mesh
Unity Catalog Enterprise Mesh: Centralized metadata management and security policies.
Event Architecture

Kafka Event Integration

Decoupled streaming pipelines for IoT smart meters, vehicles, and operational telemetry.

  • Apache Kafka
  • Fivetran
  • Snowpipe
  • Event Bus
events.platform.io
Kafka Event-Driven Integration: Streaming ingestion for IoT and operational telemetry.
Data Observability

Data Quality Sentinel

Automated monitoring for pipeline failures, data freshness, schema drift, and SLAs.

  • dbt Tests
  • Airflow
  • Observability
  • CI/CD
sentinel.observability.nz
Data Quality Sentinel: Automated freshness monitoring and pipeline health checks.
Distributed Systems

Multi-Region Kafka Mesh

Active-active event mesh processing millions of messages across APAC cloud zones.

  • Kafka
  • MirrorMaker 2
  • Terraform
  • Multi-AZ
mesh.apac.cloud
Multi-Region Kafka Mesh: Distributed active-active event streaming across APAC.
Data Warehousing

Azure Synapse Marts

Enterprise Kimball dimensional modeling cutting legacy query latency by 80%.

  • Azure Synapse
  • ADLS Gen2
  • T-SQL
  • Kimball
synapse.analytics.cloud
Azure Synapse Marts: Kimball dimensional warehouse modernization.

Journey

The work.
The journey.

  1. Lead / Senior Data Engineer Jan 2025 – Present

    WEL Networks, New Zealand · Jan 2025 – Present (Active)

    Delivered consistent, reusable data provisioning by leading the enterprise data platform build across Snowflake, Azure Data Lake/Blob, FME, dbt/Coalesce, Airflow, Fivetran, Python and SQL, with standard ingestion, ELT and orchestration patterns. Cut manual pipeline intervention by 35% by automating pipeline execution, dependency handling and operational checks through reusable ELT components. Enabled earlier issue detection and stronger trust in analytical data by implementing monitoring for pipeline failures, data freshness, data quality and operational health. Reduced release risk for data pipelines and Power BI by establishing CI/CD and release controls with Git and Azure DevOps. Improved movement of structured, IoT and operational data by applying Kafka event-driven integration and managed ingestion patterns.

  2. Founder & Principal Data Architect 2024 – Present

    Vaan Consulting, Auckland · 2024 – Present

    Founded Vaan Consulting to deliver modern cloud data platform solutions, lakehouse implementations, automated zero-downtime data migrations, and enterprise data governance (NZISM & APRA compliance) for organizations across New Zealand and APAC.

  3. Data Architect

    Ford Motors India Ltd · Jul 2023 – Jul 2024

    Reduced data latency by 40% across multiple business domains by architecting and delivering a cloud data platform on Snowflake and Databricks with ELT, Airflow, Fivetran, Python and SQL. Cut platform cost by 30% by leading the migration of legacy ETL to cloud ELT with automated orchestration, retiring high-maintenance on-premises infrastructure. Improved reliable data movement by designing batch and streaming integration patterns with Kafka and event-driven dependencies. Increased trust in enterprise data by embedding data quality, metadata, lineage, freshness monitoring and operational support controls, while setting technical direction for a 15+ member data engineering team.

  4. Lead Data Engineer

    Bank of America · Aug 2018 – Jul 2023

    Improved operational efficiency by 20% through workflow automation, standardised pipeline patterns, reusable transformation components and structured production support. Improved governed data availability for downstream consumers by building analytical pipelines across Azure Data Lake, Snowflake and Apache Spark using Python, SQL and orchestrated ELT. Gave analytics and BI teams consistent data preparation by designing reusable integration and transformation components, and strengthened confidence in regulated financial data by supporting data quality, metadata management and accessibility controls.

  5. Lead Developer (Royal Bank of Canada)

    Cognizant Technology Solutions · Feb 2018 – Jul 2018

    Project: Data Repository for Royal Bank of Canada. Improved ingestion speed by 25% by supporting the migration from on-premises systems to an Azure Delta Lakehouse using Python automation and managed ingestion. Reduced SQL query runtime by 30% by optimising workloads that support reporting and analytics. Strengthened governance and access control by implementing Unity Catalog for metadata management and security-policy enforcement in a regulated banking environment.

  6. Senior Developer (US Bank & BNY Mellon)

    Cognizant Technology Solutions · Nov 2011 – Jan 2018

    Project: Payment Service for US Bank and Bank of New York Mellon. Enabled risk and fraud analytics teams with governed, accurate and timely data extracts across two US banking clients over 6+ years. Improved platform stability and delivery speed by migrating legacy ETL workflows to automated, cloud-oriented frameworks. Resolved complex data integration issues as the technical escalation point, coordinating with technical and business stakeholders.

Platform Architecture & Research

Beyond the
day job.

1 merged8 open

Architected enterprise lakehouses utilizing Delta Lake and Snowflake, delivering sub-second query performance for analytics across petabyte-scale workloads.

  • Delta Lake
  • Snowflake
  • dbt
  • Databricks
See the work
Step 1Step 2Step 3Step 4Step 5Answer Backslide

Illustration

Designed real-time distributed streaming pipelines on Apache Kafka with end-to-end schema validation, out-of-order event handling, and zero data loss.

  • Apache Kafka
  • Spark Streaming
  • Java
  • Azure

Illustration

Designed enterprise multi-cloud data mesh topology with automated data lineage, column-level security, and NZISM / APRA CPS 234 regulatory auditing.

  • Data Mesh
  • Data Lineage
  • NZISM
  • ISO 27001

Stack

Every layer.

  • Snowflake
  • Databricks
  • Delta Lake 3.0
  • Apache Spark
  • dbt Core
  • Microsoft Fabric
  • Azure Synapse
  • Apache Iceberg
  • Coalesce

Architecting multi-cloud lakehouse topologies, ACID transactional storage on Delta Lake, zero-copy cloning, self-serve data marts, and automated ETL/ELT pipelines.

  • Microsoft Azure
  • AWS
  • Google Cloud
  • Apache Kafka
  • Apache Airflow
  • Terraform
  • Docker
  • Kubernetes
  • FME
  • CI/CD Pipelines

Enterprise data cloud infrastructure on Azure, AWS, and GCP. Real-time distributed event streaming clusters with Kafka, automated IaC with Terraform, and zero-downtime database migrations.

  • Power BI
  • DAX
  • CortexSearch
  • ArcGIS Products
  • NZISM Compliance
  • APRA CPS 234
  • Cloud FinOps
  • Data Mesh
  • ISO 27001

Governed semantic models and executive reporting in Power BI, enterprise FinOps cost policy engines (35% compute reduction), spatial utilities analytics with ArcGIS, and strict NZISM/APRA regulatory security.

  • Java 17
  • Python
  • SQL
  • Spring Boot
  • Hibernate
  • REST APIs
  • Node.js
  • Microservices
  • Oracle DB

Scalable distributed backends, high-throughput financial transaction processing, automated operational portals in Node.js/React Native, and robust enterprise banking settlement integrations.

Location

Auckland, New Zealand · Working across New Zealand and APAC

Specialization

Cloud Lakehouses, Real-Time Streaming, Enterprise Governance

PROVEN EXPERTISE

MY TECH STACK

Modern full-stack data engineering, robust cloud platforms, and rapid full-stack architectures.

DATA ENGINEERING & ARCHITECTURE

Apache Spark
Scala
Python
SQL
Apache Kafka
Apache Airflow
dbt
Snowflake
Hadoop

CLOUD & ANALYTICAL PLATFORMS

AWS
Google Cloud (GCP)
Azure
Databricks
BigQuery

DEVOPS & FULL STACK WEB

Terraform
Docker
React
Next.js
Node.js
TypeScript
MongoDB
MySQL

Professional Credentials &
Certifications

A comprehensive, verified record of professional qualifications spanning cloud data platforms, multi-cloud architecture, software engineering, and agile program governance.

Apr 2026

SnowPro Core Certification

SNOWFLAKE
Dec 2025

Microsoft Certified: Fabric Data Engineer Associate

MICROSOFT
Jun 2024

Certified Scrum Product Owner® (CSPO®)

SCRUM ALLIANCE
May 2024

PRINCE2 Agile® Foundation & Practitioner

PEOPLECERT
May 2024

Professional Data Engineer Certification

GOOGLE
May 2024

Microsoft Certified: Azure Data Engineer Associate

MICROSOFT
Nov 2014

Oracle Database SQL Certified Expert

ORACLE
Apr 2021

Oracle Certified Associate, Java SE 8 Programmer

ORACLE
Dec 2023

AWS Certified Solutions Architect – Associate

AWS
Feb 2024

Microsoft Certified: Azure Fundamentals

MICROSOFT
Apr 2024

Certified SAFe® 6 Product Owner/Product Manager

SCALED AGILE
Apr 2024

Microsoft Certified: Power BI Data Analyst Associate

MICROSOFT
Apr 2024

Certified SAFe® Agilist

SCALED AGILE
Feb 2024

Using DAX throughout Power BI to create robust data scenarios

COURSERA
Feb 2024

Power BI for beginners Introduction to DAX Language

COURSERA
Feb 2024

Build Dashboards in Power BI

COURSERA
Feb 2024

Getting Started with Power BI Desktop

COURSERA
Jun 2023

Oracle certified professional Java SE 11 Developer

ORACLE
Aug 2015

Level 1: Cards and Payment

COGNIZANT
Mar 2015

Level 1: Investment Banking and Brokerage

COGNIZANT
Feb 2013

Level 0: Banking and Financial Services

COGNIZANT
Sep 2014

Level 0: Core Java

ORACLE
Jun 2013

Oracle Certified Java Profession edition 6

ORACLE
Feb 2016

Oracle Certified Professional, Java EE 5 Web Component Developer...

ORACLE
Feb 2024

Databricks Certified Data Engineer Associate

DATABRICKS
Oct 2023

AWS Certified Cloud Practitioner

AWS
Jan 2024

Generative AI for Data Engineers Specialization

COURSERA
Mar 2024

Google Cloud Certified Associate Cloud Engineer

GOOGLE
Let's build
Together.

Got an enterprise data platform that needs to scale with zero downtime? Tell me about it.

Or just email vasanthvimal@gmail.com

Scanning page