Total 4 years of IT Experience in Big Data Ecosystems and Android. Having vast knowledge of Spark, hadoop, hdfs, Hive, Kafka, Zookeeper, Vespa(Elasticsearch), AWS services like S3, EMR, ec2, etc). Integrated experience like SparkSQL to improve the performance. Worked with Etl tools like NIFI. Good knowledge of docker and Nginx. Familier with data architecture including data ingestion pipeline design. Capable of processing the large sets of structured, semi-structured and unstructured data from a wide variety of data sources. Good experiece of databases like postgres, sqlite and cassandra. Building the infrastructure required for optimal extraction, transformation, and loading of large datasets. Good knowledge of linux shell scripting. ©