This listing was posted on The Resumator.
Data Engineer
Location:
Cairo
Description:
Job Summary: We are seeking a talented Data Engineer to join our team. This role offers flexibility with the opportunity for remote work and occasional onsite collaboration in Cairo, Egypt. The ideal candidate will have extensive experience in building and maintaining data pipelines, with a strong proficiency in SQL and Python. Our Tech Stack: Languages: SQL & Python Pipeline Orchestration Tool: Dagster (Legacy: Airflow) Data Stores: Snowflake, Clickhouse Platforms & Services: Docker, Kubernetes PaaS: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others) ETL: FiveTran & DBT for transformation IaC: Terraform (with Terragrunt) Key Responsibilities: Develop and maintain ETL pipelines using SQL and/or Python. Use tools like Dagster/Airflow for pipeline orchestration. Collaborate with cross-functional teams to understand and deliver data requirements. Ensure a consistent flow of high-quality data using stream, batch, and CDC processes. Use data transformation tools like DBT to prepare datasets for business users to self-service. Ensure data quality and consistency across all data stores. Monitor and troubleshoot data pipelines for performance and reliability. Essential Experience: 3+ years of experience as a data engineer. Proficiency in SQL. Experience with modern cloud data warehousing and data lake solutions like Snowflake, BigQuery, Redshift, Azure Synapse. Experience with ETL/ELT, batch, and streaming data processing pipelines. Excellent ability to investigate and troubleshoot data issues, providing fixes and proposing both short and long-term solutions. Knowledge of AWS services (such as S3, DMS, Glue, Athena, etc.). Familiarity with dbt or other data transformation tools. Other Desired Experience: Experience with AWS services and concepts (such as EC2, ECS, EKS, VPC, IAM, etc.). Familiarity with Terraform and Terragrunt. Experience with Python. Experience with orchestration tools like Dagster, Airflow, AWS Step Functions, etc. Experience with pub-sub, queuing, and streaming frameworks such as AWS Kinesis, Kafka, SQS, SNS. Familiarity with CI/CD pipelines and automation. Application Process: To apply, please submit your resume detailing your experience and qualifications for this role. We look forward to reviewing your application and exploring how you can contribute to our team. Equal Opportunity Employer: We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.Powered by JazzHR
Company:
Northbay Solutions
Posted:
June 3 on The Resumator
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to The Resumator
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.