About the role

Aplyr's Quick Take

This role is about building and maintaining automated data processing systems. You'll be coding, optimizing data pipelines, and ensuring data quality while collaborating with data analysts and other teams. It's primarily an individual contributor role focused on technical execution.

Good fit

Ideal candidates have at least a year of experience in data engineering or automation, are proficient in Python or similar scripting languages, and are comfortable working with data pipelines and cloud platforms. A collaborative mindset and strong problem-solving skills are essential.

Worth noting

The position emphasizes both real-time and batch data processing, which may require flexibility in work style. The role is based in Egypt, which could be a consideration for remote work preferences.

Position:

Data Automation Engineer

Job Description:

As a Data Automation Engineer, you will play a crucial role in developing and maintaining automated data processing systems. You will work closely with data analysts, and other stakeholders to design, implement, and optimize data pipelines, ensuring the efficient and accurate flow of data throughout the organization.

What You'll Do:

Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data.
Integrate data from various sources in both real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability.
Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
Collaborate with other intelligent data teams.
Ensure seamless data flow for machine learning and analytics applications.
Implement monitoring systems to track data pipeline performance and identify areas for optimization.
Continuously optimize data processes for efficiency and scalability.
Document data processes, system architecture, and codebase for knowledge sharing and future reference.
Keep documentation up-to-date with any changes or enhancements to the data infrastructure.
Implement and adhere to data security and compliance standards.
Collaborate with security teams to ensure data protection and privacy.

You're a Perfect Fit If You Have:

1+ years of experience in data engineering, automation, or a related field.
Strong understanding of data pipelines and data lifecycle management.
Proficiency in scripting languages like Python, Shell, or similar.
Experience with data automation tools (Airflow, Luigi, etc.) a plus.
Excellent analytical and problem-solving skills.
Strong communication and collaboration skills to work effectively across teams.
Knowledge with cloud platforms (AWS, Azure, GCP) for data processing.

Knowledge of data warehousing and data quality methodologies

Location:

EG-Banha, Egypt (EI Corniche Street)

Time Type:

Full time

Job Category:

Information Technology

Skills & Tags

data

Aplyr's read

Arrow Electronics is a key player in technology solutions, employing a diverse workforce from engineers to sales professionals to drive innovation in electronics distribution.
Synthesized from recent postings & public sources

What's promising

•Strong global presence with operations in over 80 countries, offering vast career opportunities.
•Diverse role offerings from engineering to sales, catering to various career paths.
•Focus on cutting-edge technology solutions, keeping employees at the forefront of industry advancements.

What to watch

•Highly competitive industry may lead to pressure on margins and job security.
•Complex organizational structure could lead to bureaucratic challenges.
•Rapid technological changes require constant skill updates, potentially increasing employee stress.

Why Arrow Electronics

•Specializes in both electronic components and enterprise computing solutions, offering a broad industry scope.
•Strong emphasis on innovation, reflected in diverse engineering and technical roles.
•Global distribution network provides employees with international exposure and opportunities.

Aplyr’s read is generated by AI from public sources. Was it useful?