Job Description
Role: Business Intelligence-BI Specialist
📍Location: Toronto, ON (Hybrid- 3 days in office)
💼Duration: Long Term Contract
Note: Need only Canadian Authorized candidate.
Must haves:
• 3+ Azure Data Lake and Data Warehouse, and building Data bricks notebooks (Must Have)
• 3+ years in ETL tools such as Microsoft SSIS, stored procedures (Must Have)
• 3+ years Python and PySpark (Must Have)
Description
General Responsibilities
• Design, develop and implement data ingestion pipeline from Oracle source to Azure Data Lake and Databricks – initial load and incremental ETL. Used tools are:
• Oracle Goldengate (knowledge and experience are an asset) for data ingestion and Change Data Capture (currently in final stages of proof of concept)
• Azure Data Factory (good knowledge) to orchestrate pipeline execution
• Azure Databricks/PySpark (expert Python/PySpark knowledge required) to build transformations of raw (bronze) data into curated zone (silver) and DataMart zone (gold)
• Power Designer (asset) to read and maintain data models
Skills Experience:
• Experience of 7+ years of working in Data Warehousing and ETL development
• Experience of 3+ years of working with Databricks , Azure Data Factory, and Python/PySpark
• Experience of 3+ years of working with SQL Server, SSIS, and T-SQL Development
• Experience building data ingestion and change data capture using Oracle GoldenGate
• Experience working with building Databases, Data Warehouse and Data Mart and working with incremental and full loads
• Experience with any ETL tools such as Azure Data Factory and SqlServer Integration Services
• Experience working with MS SQL Server and other RDBMS (Oracle, PL/SQL)
• Experience on dimensional data modeling, and tools – e.g. PowerDesigner,
• Experience with snowflake and star schema model; experience in designing data warehouse solutions using slowly changing dimensions.
• Experience with Delta Lake concepts and Medallion architecture (bronze/silver/gold)
Skills:
• 3+ Azure Data Lake and Data Warehouse, and building Databricks notebooks (Must Have)
• 3+ years in ETL tools such as Microsoft SSIS, stored procedures (Must Have)
• 3+ years Python and PySpark (Must Have)
• Azure Data Factory
• Oracle Goldengate
• SQL Server
• Oracle
• Ability to present technical solution to business users