Senior Data Engineer

Dicetek LLC


Date: 2 days ago
City: Dubai
Contract type: Contractor
Min Work Experience 10+ Years

Role: Senior Data Engineer

  • Extensive experience in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.
  • Write and tune complex Java, MapReduce, and Hive jobs.
  • Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important.
  • Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices.
  • Manage team of data engineers (both full-time associates and/or third-party resources)
  • Analyzes and confirms the integrity of source data to be evaluated.
  • Leads in deployment and auditing models and attributes for accuracy.
  • Experience with stream-processing systems: Spark-Streaming, Strom etc.
  • Experience with object-oriented/object function scripting languages: Python, Scala etc.
  • Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data.
  • Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with Azure cloud services is a plus.
  • Financial Services Knowledge is a plus.

Requirement

  • Previous experience 10+ as a big data engineer.
  • In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
  • Own most deliverables for the Big Data team from a delivery perspective.
  • Ability to solve complex networking, data, and software issues.
  • Able to Effectively Plan & Organize Their Work
  • Strong Interpersonal Communication
  • Assist others in the completion of their tasks to support the group goals.
  • Build and maintain cooperative work relationships with others.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

DIRECTOR - INNOVATION & EMERGING TECHNOLOGY

DP World, Dubai
4 hours ago
Job DescriptionKEY RESPONSIBILITYDirect the operations and strategic roadmap of the Innovation Lab, fostering experimentation and disruptive thinking.Oversee design, development, and enterprise-scale rollout of RPA and AI initiatives across multiple business units.Lead end-to-end innovation project lifecycle.Lead innovation forums, hackathons, and internal idea challenges to generate grassroots innovation.Provide executive-level insights on technology disruption, innovation strategy, and investment priorities.Drive change management efforts to...

Sales Engineer

Weir Minerals, Dubai
6 hours ago
Job Title: Sales EngineerDivision: Weir MineralsLocation: DubaiOnsitePurpose of Role: This role is responsible for handling inquiries for slurry pumps and mineral processing products, conduct sales and marketing activities, after market support, manage customer relationships, and contribute to business growth within the region, focusing on achieving company KPIs.Why choose Weir: Be part of a global organization dedicated to building a better...

Electrical Technician G2

ENGIE Deutschland, Dubai
1 day ago
Job TitleElectrical Technician G2DepartmentFacility ManagementReporting ToFM SupervisorSite Job Purpose: Install and maintain wiring, control, and lighting systems. Inspect electrical components, such as transformers and circuit breakers. ... Repair or replace wiring, equipment, or fixtures using hand tools and power tools.Key Responsibilities Investigates problems and performs repairs on various mechanical and electrical equipment Performs preventative maintenance on various mechanical and electrical...