Skip to content
View abhisheksd27's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report abhisheksd27

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
abhisheksd27/README.md

Hey there, I'm Abhishek Shankar πŸ‘‹

Data Engineer & Cybersecurity Specialist πŸ›‘οΈβš‘

LinkedIn GitHub Twitter/X Dev.to Stack Overflow YouTube


β€œArchitecting scalable, fault-tolerant distributed data platforms and fortifying cloud ecosystems through proactive security, zero-trust architectures, and data governance.”


πŸ›‘οΈ About Me & Core Focus

  • πŸŽ“ Education: Degree in Information Science and Engineering with specialization in distributed computing, network security, and data structures.
  • ⚑ Data Engineering: Designing end-to-end Medallion lakehouses, real-time event streaming architectures (Kafka, Spark Streaming), and automated orchestration pipelines (Airflow, dbt, BigQuery).
  • πŸ”’ Cybersecurity & Data Governance: Implementing Zero-Trust principles, IAM/RBAC policy hardening, end-to-end data encryption (AES-256, TLS 1.3), automated vulnerability audits, and OWASP-compliant API security.
  • πŸ† Hackathons & Competitions: Smart India Hackathon (SIH) 2022 participant β€” engineered high-availability prototypes solving real-world civic and operational challenges.
  • πŸ”­ Current Focus: Real-time stream processing, secure cloud infrastructure provisioning with Terraform, and security automation (SecOps).

πŸ’Ό Experience

πŸ”Ή Data Engineering & Security Intern / Developer

Focus: Distributed Pipelines, ETL/ELT, Data Quality & Access Control

  • Architected and deployed end-to-end batch and real-time streaming pipelines processing high-volume datasets using Apache Kafka, PySpark, and Airflow.
  • Enforced automated data quality frameworks with Great Expectations and centralized transformations using dbt.
  • Hardened database and pipeline security by integrating KMS-based secret management, strict IAM roles, and VPC peering for private data transit.

πŸ”Ή Full-Stack & Systems Security Intern

Focus: Secure Microservices, Auth Systems & Network Hardening

  • Developed resilient RESTful microservices and web interfaces using React, Node.js/Express, FastAPI, and Flask.
  • Built secure authentication pipelines utilizing OAuth2, JWT with rotation, salted Argon2/bcrypt hashing, and granular RBAC authorization.
  • Conducted API vulnerability scanning, rate limiting, and input sanitization to safeguard against OWASP Top 10 vulnerabilities (SQLi, XSS, CSRF, SSRF).

πŸ“œ Certifications & Accreditations

πŸ”’ Cybersecurity & Cloud Security

  • Google Cybersecurity Professional Certificate β€” Google / Coursera
  • Network Security & Threat Detection β€” CompTIA / Cisco Networking Academy
  • Ethical Hacking & Information Security Principles
  • Cloud Security Fundamentals (IAM, VPC, Zero-Trust)

⚑ Data Engineering & Machine Learning

  • Data Engineering with Python & Big Data (Spark, Kafka)
  • Google Cloud BigQuery & Data Warehousing
  • Machine Learning & Applied Data Science β€” NumPy, Pandas, Scikit-Learn
  • SQL for Advanced Data Analytics & Database Design

(Feel free to adjust certificates or link your badge URLs directly to verify on Credly/LinkedIn!)


🌟 Featured Projects

Production-Grade Data Engineering Lakehouse & Intelligence Engine

  • Constructed a complete Medallion Lakehouse (Bronze βž” Silver βž” Gold) with Apache Kafka, Debezium CDC, Apache Spark, and Airflow.
  • Automated cloud data warehousing in GCP BigQuery with modular dbt modeling and CI/CD quality testing.
  • Infra as Code (IaC) provisioned via Terraform and fully containerized with Docker.

πŸ›‘οΈ Security Log Analyzer & Intrusion Detection

Automated Threat Intelligence & Network Packet Analysis

  • Implemented high-throughput security log ingestion scripts using Python and Bash to flag suspicious network activities and brute-force attempts.
  • Parsed audit logs and visualized security telemetry dashboards with automated alerting mechanisms for anomaly detection.

πŸ€– Road Accident Prediction & Risk Analytics

Machine Learning & Geospatial Safety Modeling

  • Trained classification models (KNN, Decision Trees, Gaussian Naive Bayes) predicting accident-prone zones based on environmental indicators.
  • Conducted extensive exploratory data analysis and feature engineering using Pandas, NumPy, and Matplotlib.

🌐 Secure Full-Stack Web Platform

MERN Architecture with Zero-Trust Security Controls

  • Engineered a scalable full-stack application featuring role-based access control, cryptographic token verification, and automated rate-limiting.
  • Structured ACID-compliant schemas and caching layers across PostgreSQL, MongoDB, and Redis.


πŸ› οΈ Technical Skill Matrix

⚑ Data Engineering & Analytics

Apache Kafka Apache Spark Apache Airflow Google BigQuery dbt Pandas NumPy Tableau

πŸ”’ Cybersecurity, Networking & Infrastructure

Network Security IAM & Auth OWASP Cryptography Linux Bash Docker Terraform

πŸ’» Languages & Frameworks

Python C++ JavaScript TypeScript SQL FastAPI Flask React Node.js

πŸ—„οΈ Databases & Storage

PostgreSQL MySQL MongoDB Firebase GCS


πŸ“Š GitHub Activity & Metrics

GitHub Stats Top Languages
GitHub Streak

Let's connect and build secure, high-scale data systems. Reach out on LinkedIn!

Pinned Loading

  1. Road-Accident-Prediction-model Road-Accident-Prediction-model Public

    Jupyter Notebook 1

  2. Data-Engineering Data-Engineering Public

    Workshop Code spaces

    Python

  3. gcp-cloudrun-postgres-starter gcp-cloudrun-postgres-starter Public

    Python

  4. gcp-data-engineering-pipeline gcp-data-engineering-pipeline Public

    Python