Big Data Engineer - Government Sector - 1
موقع الوظيفة:
الراتب شهرياً:
تاريخ النشر:
عدد الوظائف الشاغرة:
ملخص الوظيفة
Apt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.
Key Responsibilities:
Data Pipeline Development:
- Build robust data pipelines usingPython SQL/NoSQL and Airflow
- DevelopETL/ELT processesfor structured/unstructured data
- Managedata lakesand optimize storage solutions
Data Infrastructure:
- Design efficientdata modelsfor analytics
- Implementdata governanceand quality frameworks
- Work withcloud-based data platforms(Azure preferred)
AI/ML Support:
- Prepare and process datasets for machine learning applications
- Collaborate with ML teams on feature engineering
Requirements
- 10-12 yearsof hands-on big data experience
- Expertise in:
- PythonandSQL/NoSQLdatabases
- Airflowfor workflow orchestration
- ETL/ELTpipeline development
- Cloud data platforms(Azure AWS or GCP)
Benefits
To be discussed
المهارات المطلوبة
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- البيانات الضخمة
- مستودع البيانات
- Kafka
- Scala
عن الشركة
Providing Apt Recruitment Solutions Experts who make sure that your recruitment needs are handled using only best practices Lead by professionals with a collective experience of over 3 decades in the recruitment segment, within various business verticals. Our company has evolved throu ... اعرض المزيد
