Data Engineer | AI/ML Solutions Expert
SHIVAM'S
P.O.R.T.F.O.L.I.O
Hello, I'm Kumar Shivam, a Finance Associate at Goldman Sachs with
extensive experience in data engineering and AI/ML solutions. I
have a strong background in building high-performance data
pipelines, optimizing financial systems, and leading
cross-functional teams.
My experience spans across major consulting firms and technology
companies, where I've consistently delivered impactful solutions.
I'm passionate about leveraging technology to solve complex
financial problems, building scalable data infrastructure, and
mentoring teams.
My professional journey spans across leading financial services and consulting firms, where I've consistently delivered high-impact solutions in data engineering, finance technology, and AI/ML.
Leading finance technology initiatives including optimizing Finance Stats Models for trade netting at multiple hierarchies. Architected microservices for high-performance data pipelines, achieving 82% HDFS I/O efficiency improvement and 60% data latency reduction through enterprise-scale HDFS to Snowflake migration. Built custom ORM frameworks reducing query latency by 47%.
Led a team of 5 Data Engineers & SQL DBAs, collaborating with 25+ US Higher Ed institutions. Developed real-time thread monitoring tools using ELK stack, automated vulnerability assessment reports, and built full-stack solutions using Next.JS and GraphQL for college websites. Created comprehensive ETL pipelines using Python and MSSQL.
Designed end-to-end data pipelines for Fortune 500 clients including Nestle & Starbucks using Azure, PySpark & Databricks. Developed auto-forecast prediction software with StreamLit visualization and implemented MLOps pipelines with CNN image classifiers using Kubernetes orchestration and Prometheus monitoring.
Built Azure Machine Learning models with hypothesis testing using Python for sales prediction on 5M+ data rows. Coordinated data warehouse implementation using Snowflake for scale-independent computation. Developed Python image analysis scripts using OpenCV, TensorFlow, Hugging Face and YOLO AI for hand gesture recognition and product analysis. Created Android applications with IoT-enabled smart containers for supply chain systems.
Cloud & Big Data: Azure, AWS, Snowflake, HDFS,
Databricks, PySpark, ELK Stack, Kubernetes, Docker
Databases: MSSQL, PostgreSQL, MongoDB, Redis,
Firebase
Machine Learning & AI: Azure ML, TensorFlow,
OpenCV, Scikit-learn, Hugging Face, YOLO AI, StreamLit, MLOps
Web Technologies: Node.js, Next.js, React,
GraphQL, Express.js, Django, Flask, Three.js
Core Languages: Python, Java, JavaScript, C++,
TypeScript, SQL, HTML/CSS
Specialized: GLSL, Android Development
(Java/XML), OCR Technologies
Frameworks: Spring Boot, Android Studio, IoT
Development
Development Tools: Visual Studio Code, Android
Studio, Jupyter Notebook, Git, Jenkins
Database Tools: PG Admin, SSMS, MongoDB Compass
System Administration: Linux, Prometheus, Kibana,
Microservices Architecture
Finance Technology: ORM Frameworks,
High-Frequency Trading Systems, Risk Management
Feel free to explore my repositories and reach out to me. I'm always looking for opportunities to learn and grow as a developer.
Explore my portfolio through an interactive terminal interface. Click on the 3D computer below to access the terminal experience.
Click to access terminal portfolio →