Job Vacancy in Egypt:
The Big Data Engineer is responsible for designing, building, and optimizing scalable data solutions. They bridge data engineering teams and stakeholders to ensure efficient data processing, storage, and analysis.
Responsibilities:
- Develop & Maintain Data Pipelines: Design, build, and optimize scalable ETL/ELT pipelines for processing large datasets.
- Implement Big Data Solutions: Work with technologies like Hadoop, Spark, Kafka, and cloud-based data platforms.
- Optimize Data Performance: Ensure data processing efficiency, query optimization, and cost-effective storage solutions.
- Ensure Data Quality & Security: Implement best practices for data governance, integrity, and compliance.
- Collaborate with Teams: Work closely with data scientists, analysts, and stakeholders to support business objectives.
- Monitor & Troubleshoot: Identify and resolve performance bottlenecks in data infrastructure.
Required Skills:
- Knowledge in setting up and managing big data infrastructures, including technologies like Hadoop, Spark, Kafka, Hive, and Presto.
- Expertise in data ingestion.
- Processing and storage solutions.
- Strong background in distributed systems and scalable architectures
Qualifications and Experience:
- Bachelor's degree in Computer Science or equivalent.
- Minimum of 2 years hands-on experience.
Get an IT job and make your IT career in ITG. To get updates on our IT vacancies, check our career page or subscribe to our LinkedIn