| 01 · Cloud & Lakehouse Platforms |
AWS (Control Tower, Organizations, EKS, ECS Fargate, S3, Glue, Athena, Lambda, Kinesis, IoT Core,
Redshift, KMS), Snowflake, Apache Iceberg, ClickHouse, DuckDB |
Multi-petabyte telecom, rail & banking lakehouses; 50M+ daily IIoT sensor files
ingested across 60+ microservices |
| 02 · High-Throughput Data & Streaming |
Python, C++ PyArrow (Zero-Copy), Polars, Apache Arrow, Apache Spark, Kafka, AWS Kinesis, Zstd
Parquet, Stateful Micro-Batching |
~300,000 records/sec per worker under <80 MB RAM; daily EL cut
from 14.5h to 3.5h at 1/10th Spark CPU/RAM cost |
| 03 · Data Modeling, Governance & Factory |
dbt Core / Cloud, Hybrid Data Vault 2.0 (Raw + Business Vault), Kimball Star Schemas, AI-Assisted /
Agentic Data Development Factory (AI Skills & MCP for Data Engineering, Architecture, Governance
Audit & DB Performance Tuning) |
30%+ faster enterprise analytics delivery; 15,000+ lines of
fragile legacy SQL refactored with 100% crash elimination |
| 04 · Agentic AI & GenAI Engineering |
Amazon Bedrock, Anthropic Claude, OpenAI, FastMCP (Model Context Protocol), Hybrid RAG (pgvector,
OpenSearch), LangGraph, Claude Code, Cursor, Gemini CLI ("Loop Engineering") |
10x developer productivity multiplier; ~60% faster engineer
onboarding; deterministic RAG evaluation harnesses |
| 05 · DevSecOps & Infrastructure as Code |
Terraform / OpenTofu, HashiCorp Packer (Golden AMIs), Docker, Kubernetes (EKS / Karpenter), Jenkins,
GitHub Actions, GitLab CI, Linux Kernel & I/O Tuning |
1,000x CI/CD release acceleration (cut regulated release cycles from 6
weeks to 6 minutes during Yahoo's $5B M&A) |
| 06 · Cloud, Licensing & LLM FinOps |
tokener (Self-Hosted LLM Cost Proxy), AWS CUR, Cost Explorer, Savings Plans, Graviton4,
Hard-Partitioned ESXi / Dedicated Host Commercial DB Licensing |
>£1,000,000/yr saved via 85% Oracle core reduction; ~22% unattributed
cloud & AI spend recovered |
| 07 · Enterprise Database Estates & Exadata |
Oracle Exadata RAC (X9M-2 / X10M, Smart Scan, DBRM, CBO SQL Patches, Hash Partitioning, HyperLogLog
Stats), Amazon Aurora, RDS PostgreSQL, SQL Server (200+ instances), AWS DMS, Debezium CDC |
Uncaged +512 Exadata threads (+40% CPU), -99.9% CPU quantum waits,
-5.0h/day nightly batch, ~18.6 TB/day temp spills eliminated;
80 TB zero-data-loss UK policing migration |
| 08 · Observability & Reliability (SRE) |
OpenTelemetry, Prometheus, Grafana, AWS CloudWatch, Datadog, Chaos Game-Days, Automated Data Quality
& Reconciliation Gates |
Sub-minute streaming pipeline observability across 25B-26B daily records; zero-downtime production
cutovers |
| 09 · Governance & Regulatory Compliance |
SOC 2 Type II, HIPAA, PCI-DSS, GDPR / KVKK, ISO 27001, DORA, UK Official-Sensitive, Architecture
Decision Records (ADRs), Async Video RFCs |
Audit-ready AWS landing zones and traceable Data Vault 2.0 lineage delivered in 3 to 6 weeks |