PI4 Cloud Data_32_1/2/3
Internship Bangalore (Bangalore Urban)
Job description
Position title – Cloud Data Architect
Location: Bangalore – Global Delivery Services
Jobpurpose:
Cloud Data Architect in the IT Advisory Servicesteam to be part of the delivery of Data/Digital based projects for ourcustomers across the globe.
TechnicalResponsibilities:
· Big data Engineer with 10 to 15 years of ITexperience including 5 to 7 years in Big Data and Analytics field,developing E2E Data pipelines to perform batch and Real - Time/Streamanalytics on structured and unstructured data on Azure.
· Expertise indesigning scalable Big Data solutions, data warehouse models on large-scaledistributed data, performing wide range of analytics on Events Ingestion,Storage and processing on Azure.
· Expertise in building solutions using Cosmosdb , Azure Data Lake, Azure Storage, Azure Databricks(Spark , and SparkStreaming),
· Experience in Big Data Analytics and design inHadoop ecosystem using Spark/Spark Streaming, Kafka.
· Solid understanding of data processing patterns,distributed computing and in building applications for real-time and batchanalytics.
· Strong programming skills in design and implementationusing Python, Scala and PySpark
· Hands on DataIngress, Egress, Processing using Kafka, Azure Data Factory , Azuredata Lake, Azure Databricks(Spark / Streaming).
· Goodknowledge on NoSQL Data bases such as HBase, Cassandra, MongoDB,Redis and usingSPARK streaming for real time stream processing of data into the cluster.
· Experience with multiple Hadoop file formats like Avro, Parquet, ORC, and JSON etc.
· Developing, constructing, testing and maintainingarchitectures for data lakes, data pipeline, data warehouses and large-scaledata processing systems on Azure.
· Leading data platform team members or equivalentthrough technical design, and implementation of solutions.
Requirements(Qualifications)
We are looking for the candidates with the following:
· BE/BTech/MCA with a sound industry experience of 10to 15 years
Mandatory skills:
· Spark, Scala,PySpark,Python,Java
· Hands-on Azureexperience – Azure Data Factory, Kafka, Hbase, Cassandra, Mongodb, AzureDatabricks Azure Cosmos DB,
· Azure KubernetesService,
· Azure Data LakeStorage, Azure DataBricks
· Azure Dataricks
Preferred skills:
· Data Warehousing, ETL,Hive, Flink,AWS,GCP
· Experience working onCMMI / Agile / SAFE methodologies