Data Engineer with Apache Iceberg

Data Engineer with Apache Iceberg
Mississauga, ON (Hybrid 3 days in a week)
Fulltime

Email: mohit@jconnectinc.com

Note:- looking for candidates those who are presently in Canada

Required Skills & Experience:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related quantitative field.
Proven experience as a Data Engineer or in a similar role building and optimizing “big data” data pipelines, architectures, and data sets.
Strong proficiency in programming languages such as Python (with extensive pySpark experience), Java, or Scala.
Expertise in Apache Spark for data processing, including Spark SQL, DataFrames, and RDDs.
Hands-on experience with Apache Hadoop ecosystem components, particularly HDFS.
Experience with real-time stream processing using Apache Flink.
Familiarity with data lake table formats, specifically Apache Iceberg, for managing large, evolving datasets.
Experience with relational SQL and NoSQL databases.
Solid understanding of ETL/ELT processes, data warehousing concepts, and data modeling techniques.
Good to have experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
Excellent problem-solving, analytical, and communication skills