Siddharth Nautiyal-Principal Consultant
Check rate
Experience
Principal Consultant
StatusNeo Consulting
- Consulted with CXO-level stakeholders on data strategy, architecture reviews, and modernization roadmaps across Hospitality, Finance, Retail, Sports, and Telecom
- Led an 8-member Data, Analytics & AI team delivering large-scale data engineering and warehousing solutions, mentoring juniors, and collaborating with cross-functional teams for seamless delivery
- Designed and delivered an end-to-end Medallion Architecture on Microsoft Fabric integrating Opera APIs, ReviewPro, SFTP, and on-prem sources
- Implemented Direct Lake models in Power BI, reducing dashboard load times from over 1 minute to under 10 seconds
- Launched an AI-powered Data Agent enabling conversational queries for CXOs
- Enforced role-based access control, governance, and lineage to ensure compliance and security
- Migrated pipelines from Azure Data Factory to Databricks, orchestrating transformations with dbt and Delta Lake
- Integrated Salesforce and RDBMS sources using reusable ETL frameworks with SCD1 and SCD2 handling
- Applied DataOps practices including CI/CD, monitoring, and quality checks for reliability
- Decommissioned the legacy Data Warehouse, cutting daily costs from 250 to 50 USD, achieving $75K annual savings
- Automated P&L reporting with Alteryx workflows and Power BI dashboards, cutting manual effort by 80%
- Designed advanced transformations with Crew Macros, improving reporting accuracy
- Established DataOps pipelines for automated validation and CI/CD
- Built a real-time Cricket Data Analytics Platform ingesting high-frequency JS events into Cassandra
- Developed Flask and OpenAPI microservices deployed on AKS with Docker and Kubernetes for web and mobile APIs
- Delivered real-time streaming and batch processing pipelines balancing low latency and scalability
- Enabled instant match and event updates via FCM push notifications with SSL pinning and parameterized queries for security
- Built preprocessing pipelines for catalog data, establishing Elasticsearch indexes and a Redis serving layer
- Developed FastAPI suggest APIs for high-performance search and deployed them as microservices on AKS with CI/CD
Consultant
Deloitte USI
- Designed and deployed scalable ETL pipelines using Azure Data Factory and Databricks, reducing ETL runtime by 50%
- Built reusable dimension and fact frameworks with SCD1 and SCD2 handling on Delta Lake, improving maintainability and historical accuracy
- Implemented dynamic data masking in Azure Synapse to protect PII and ensure regulatory compliance
- Partnered with cross-functional business teams to translate requirements into scalable technical solutions, improving reporting efficiency and data trust
Big Data Engineer
Reddoorz
- Built AWS ETL pipelines with Apache NiFi, Step Functions, and Redshift, optimizing SQL queries and reducing load times by 40%
- Developed Python-based validation and SCD frameworks for Redshift with monitoring and orchestration automated via CloudWatch and Lambda
- Replaced legacy reporting tool Holistic by implementing automated pipelines, reducing CXO report generation from hours to minutes
- Improved data quality and consistency across pipeline outputs, ensuring reliable executive-level reporting
Technical Associate
Genpact India Pvt. Ltd.
- Developed reusable ETL and validation frameworks in Python and Spark with SCD1 and SCD2 logic, improving data consistency across ingestion jobs
- Automated large-scale batch processing pipelines exceeding 100 TB using AWS Data Pipeline, Step Functions, Lambda, CloudWatch, and EMR, reducing manual oversight and improving reliability
- Optimized Amazon Redshift schema design and queries, improving performance and reducing storage and compute costs
- Implemented monitoring and alerting using CloudWatch and integrated workflows with CloudFormation for better orchestration
- Partnered with onshore and offshore teams to deliver data migration and modernization projects under strict SLAs
Industry Experience
See where this freelancer has spent most of their professional time.
Experienced in Tourism, Banking and Finance, Retail, Information Technology, and Professional Services.
Business Area Experience
See which departments and functions this freelancer has contributed to most.
Experienced in Business Intelligence, Information Technology, and Strategy.
Summary
Accomplished Data Architect with 8+ years of experience helping organizations transform their data into a strategic asset. Proven ability to bridge business and technology by consulting with stakeholders, shaping enterprise architectures, and delivering modern cloud-native platforms. Skilled at leading high-performing teams and guiding clients across industries including hospitality, finance, telecom, sports, power & energy and retail. Hands-on with AWS, Azure, Microsoft Fabric, and GCP, bringing a holistic approach to data engineering, governance, and analytics that drives innovation and competitive advantage.
Skills
- Programming Languages: Python, Sql, Scala
- Rdbms: Mysql, Sql Server, Oracle, Postgresql
- Nosql: Apache Cassandra, Elasticsearch, Redis
- Cloud Platforms – Aws: Redshift, S3, Lambda, Athena, Data Pipeline, Dms, Step Functions, Cloudwatch, Cloudformation, Emr
- Cloud Platforms – Azure: Data Factory, Adls Gen 2, Synapse, Databricks, Devops, Azure Kubernetes Service
- Cloud Platforms – Gcp: Google Cloud Storage, Data Proc, Google Kubernetes Engine (Gke), Bigquery, Fcm For Push Notifications
- Cloud Platforms – Microsoft Fabric: Data Pipelines, Data Flows, Notebooks, Onelake, Data Agent, Deployment Pipelines
- Big Data: Spark, Pyspark
- Backend: Flask, Openapi, Fastapi
- Ci/cd: Docker, Kubernetes, Jenkins
- Advanced Concepts: Scd Type 1 & 2, Incremental Loads, Data Quality, Master Data Management (Mdm), Dataops, Data Migration (100tb+), Real-time Streaming, Batch Processing, Microservices, Data Warehouse
- Data Engineering Tools: Apache Nifi, Informatica Cloud, Alteryx
- Version Control: Git, Bitbucket, Azure Devops
Languages
Education
AKTU
B.Tech, Computer Science Engineering · Computer Science Engineering · Lucknow, India
Statistics
Experience
Expertise
Qualifications
Profile
Frequently asked questions
Do you have questions? Here you can find further information.
Where is Siddharth based?
What languages does Siddharth speak?
How many years of experience does Siddharth have?
What roles would Siddharth be best suited for?
What is Siddharth's latest experience?
What companies has Siddharth worked for in recent years?
Which industries is Siddharth most experienced in?
Which business areas is Siddharth most experienced in?
Which industries has Siddharth worked in recently?
Which business areas has Siddharth worked in recently?
What is Siddharth's education?
What is the availability of Siddharth?
What is the rate of Siddharth?
How to hire Siddharth?
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
Similar Freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Principal Consultant
Nearby freelancers
Professionals working in or nearby New Delhi, India
Most recent projects
FRATCH works with many companies and recruitment agencies. Here you will find our recently posted projects and opportunities.
