Lead

ParamInfo


Date: 3 days ago
City: Abu Dhabi
Contract type: Full time
Job Description

Role - Data Engineer Lead (Onsite)

Job Details

  • Data Engineering Lead is responsible for the development and support for internally created or supported ETL or and database program (Big Data, data warehouse), including business requirement gathering, designing the data model and developing the solution.

Job Role & Responsibilities-

  • Responsible for the understanding and documenting the business requirements
  • Deep understanding of ETL methodologies, Big Data and Data Warehousing principles, approaches, technologies, and architectures including the concepts, designs, and usage of data warehouses
  • Works closely with business and technical teams to understand, document, design, develop, code, and test ETL processes
  • Demonstrated experience in ETL design and options to improve load and extract performance
  • Translate source to target mapping documents into ETL processes
  • Building and integrating APIs
  • Deploying ML solutions in the cloud
  • Design, Develop, Test, Optimize and Deploy ETL code and stored procedures to perform all ETL related functions.
  • Works in Agile environment and utilizes best principles of CI/CD and DevOps
  • Design the data model for the Big Data
  • Responsible for designing/implementing/managing ETL processes using Talend and Azure Data Factory
  • Responsible to administrate and maintain the Azure/MS SQL server Databases and Microsoft Enterprise Data warehouse
  • Developing Spark Job in Scala or Java
  • Write, implement, and maintain appropriate ETL processes
  • Lead, train and support the work of other staff engaged in similar functions.
  • Monitoring and maintain the following all the databases and al the ETL components
  • Designs, codes in Python and SQL, orchestrates and monitors jobs in Azure Databricks / Snowflake or any data warehouse cloud

Essential

Education & Experience Required

  • Bachelor’s Degree in Computer Science, Engineering, or a related field
  • 5+ years of experience within particular area of expertise
  • 5+ years’ experience of ETL development using Talend / Airflow
  • 5+ years’ experience of developing SQL queries, stored procedures, and views
  • 3+ years’ experience developing/coding in Python
  • 3+ years’ experience of database administration
  • 3+ years’ experience working with any cloud solutions

Desirable

  • 3+ years’ experience of Azure Databricks or any cloud data warehouse such as (Snowflake, redshift)
  • 2+ years’ experience of Azure DF

Certifications Desirable

  • Advanced certification in Azure (Azure DF, Azure ML)
  • Certification in Azure Databricks or any cloud warehouse
  • Any certification in data science is a big plus.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Director - Managed Schools - ADNOC Schools - UAE National

Aldar Education, Abu Dhabi
7 hours ago
Job DescriptionAldar Education is currently seeking a Director - Managed Schools (ADNOC) to support our growing family of managed schools in the UAE, commencing immediately.The Director – Managed Schools (ADNOC) will be fully responsible for effectively leading all school improvement strategies, marketing, and enrolment activities of the managed schools and have commercial and education line management of all managed schools....

Assistant Director of People & Culture

Mandarin Oriental, Abu Dhabi
1 day ago
As Assistant Director of People & Culture, you will be responsible for the following duties:Supports the Director of People & Culture in developing and implementing the People StrategyCarry-out benchmarking/studies to assess feasibility and implementation of various initiativesPlans and oversees the functions and performance of the People & Culture team Ensures that all P&C administration procedures are carried out in accordance...

Spa Therapist - Conrad Abu Dhabi Etihad Towers Hotel

Hilton, Abu Dhabi
2 days ago
What will I be doing?As a Spa Therapist, you are responsible for performing the following tasks to the highest standards:Performing different types of massages, beauty treatments, and wellness therapies.Maintaining detailed records of massages, treatments, and therapies performed on each spa guest.Communicating with guests during massages to adjust massage techniques as required.Resolving guest complaints and reporting any accidents to the supervisor.Cleaning...