Get Hired.

Change Preferences
  • Industry: IT Services & Consulting
  • Other Skills: JAVA, Data Lakes, Apache Flink, Kafka, ETL, Oracle BI Apps, Bash, Data Warehousing, Python
  • Required Education: B.Tech/B.E. in Any Specialization

Role Title: Senior Data Engineer (Apache Flink)

Contract/Permanent


Role Description including key deliverables:

•       Hands-on design and development of Apache Flink Pipelines to consume streaming data from Kafka and applied business logic to transform and serialize the raw data.

•       Hands-on experience in Design, development, and testing of data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested into the big data platform (Open-source columnar database Clickhouse)

•       Experience in Developing transformation logic, interfaces, and reports as needed to meet project requirements

•       Hands-on experience in developing enterprise-level using batch processing (using Apache Pig) and streaming framework (using Spark Streaming, Apache Kafka, and Apache Flink)

•       Experience with Flink, Clickhouse & Kafka implementation, integration, and administration in the following Streaming Data-Streaming frameworks or services: Apache Kafka, Kinesis Data Streams, Apache Spark Streaming, and Apache Flink)

•       Experience in CI/CD process

•       Experience in the design and development of BI/Analytics solutions using Oracle Analytics Cloud, Python Flask, data modeling, dimension modeling, ETL process & data integration.

•       Hands-on experience in formatting the raw data and extensively worked on various data formats such as Text, Avro, Parquet, ORC, CSV, JSON ETCH.

•       Experience in normalizing to 3NF/De-normalization techniques for optimum performance.

•       Experience with SQL(Oracle, Postgres), Columnar database (Clickhouse,) and NoSQL databases (Druid)

•       Hadoop fundamental concepts

•       Scripting experience in bash, Python

•       Experience in training technical users in Apache Flink, Clickhouse, and Kafka

Skills:

•       4 + Years of hands-on ETL pipeline development experience in Apache Flink using Java.

•       4+ Years of experience working on event streaming platforms like Kafka

•       4+ Years of Java development Experience

•       4+ years industry experience as a Data Engineer with demonstrated experience in data modeling, ETL Development, Data Warehousing, Data Lakes, and/or consolidating data from distributed systems

•       2+ Years experience in training users in Flink and other big data technologies such as Clickhouse, Kafka

•       Nice to have 2+ Years of Experience in Oracle BI Apps and familiarity with the Oracle BI Apps data model.

•       Nice to have experience in using ETL tools (Informatica, Oracle Data Integrator)

About the Company

Hiring for our direct client.

Apply with a Professional Resume

It's your first impression.

Create Resume
Apply Now