The Stack Overflow podcast is back! Listen to an interview with our new CEO.
147
reputation
3

Shubham A.

I'm a highly experienced Big Data Engineer with experience in building distributed systems with Hadoop Framework and underlying Storage Management with HDFS and YARN-based deployments for Apache Spark for In-Memory data processing. Some technologies I use everyday includes:

  • Hadoop Framework and underlying Storage Management with HDFS
  • Apache Spark for In-Memory data processing, Hive for analytic queries
  • Spring Boot microservices, Apache Kafka, RabbitMQ, Netflix Zuul API Gateway, Spring Eureka, GraphQL, RESTful APIs, Hystrix, Ribbon
  • Used MySQL, MongoDB, Cassandra and Elasticsearch databases to power the backend
  • Unit test cases using Junit, Mockito. Kept code coverage above 95%
  • Used PrestoDB (Petabyte scale SQL engine), AWS S3, Apache Hive, Amazon Athena & AWS EMR
  • ETL with Apache NiFi and Apache Kafka

I have worked extensively on the serverless platform with following services in AWS:

  • AWS Lambda to expose microservices, AWS SAM CLI
  • AWS API Gateway for routing and triggering Lambda
  • AWS CloudFormation and CloudWatch for event-based triggers
  • Auto-scaling with Elastic Container Service (ECS) and Kubernetes (EKS)
  • AWS Cognito for Identity management and restricted access
  • AWS CloudCommit and CloudDeploy pipelines for complete DevOps pipelines
3
answers
0
questions
~25k
people reached

Top tags (6)

Score 2
Posts 1
Posts % 33
Score 2
Posts 1
Score 1
Posts 1
Score 1
Posts 1
Score 0
Posts 1
Score 0
Posts 1

Top posts (3) All Questions Answers | Votes Newest

Badges (3)

Gold

Silver

Bronze

3

Rarest