Senior Data Engineer
Dicetek LLC
Date: 3 weeks ago
City: Dubai
Contract type: Contractor
Min Work Experience 10+ Years
Role: Senior Data Engineer
Role: Senior Data Engineer
- Extensive experience in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.
- Write and tune complex Java, MapReduce, and Hive jobs.
- Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important.
- Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices.
- Manage team of data engineers (both full-time associates and/or third-party resources)
- Analyzes and confirms the integrity of source data to be evaluated.
- Leads in deployment and auditing models and attributes for accuracy.
- Experience with stream-processing systems: Spark-Streaming, Strom etc.
- Experience with object-oriented/object function scripting languages: Python, Scala etc.
- Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data.
- Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with Azure cloud services is a plus.
- Financial Services Knowledge is a plus.
- Previous experience 10+ as a big data engineer.
- In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
- Own most deliverables for the Big Data team from a delivery perspective.
- Ability to solve complex networking, data, and software issues.
- Able to Effectively Plan & Organize Their Work
- Strong Interpersonal Communication
- Assist others in the completion of their tasks to support the group goals.
- Build and maintain cooperative work relationships with others.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
MIS Analyst
Dicetek LLC,
Dubai
6 hours ago
The purpose of this job is to support the implementation of the risk analytics tool. The ideal candidate will be responsible for translating business requirements into logical scenario, supporting the creation and validation of data pipelines feeding into the tool and conducting thorough end-to-end testing to ensure data accuracy and tool reliability.Main Tasks Collaborate with risk stakeholders to understand functional...
OFFICER – CUSTODY OPERATIONS (DIGITAL ASSET)
Dicetek LLC,
Dubai
10 hours ago
The Custody Operations Officer will support the Line Manager in the day-to-day operations of the bank’s digital asset custody services. Will be responsible for executing operational tasks, ensuring the security and accuracy of digital asset transactions, and maintaining compliance with regulatory standards. This role requires a foundational understanding of blockchain technology, attention to detail, and the ability to work collaboratively...
Store Manager
Procat Catering Services LLC,
Dubai
13 hours ago
Company Description Procat Catering Services LLC has been a leading provider of professional catering services in the UAE since 2002. With a decade of experience, we understand the needs of our discerning clients and offer unique food service solutions tailored to every budget. Our services include end-to-end large volume catering for labor-intensive companies, corporate functions, events, institutions, and staff accommodations....
