Join our dynamic team as a Data Engineer and play a pivotal role in designing and maintaining cutting-edge data systems and pipelines.

Responsibilities:

• Analyze and organize data to ensure data quality and reliability.
• Design, build, and maintain scalable data systems and pipelines to support business needs.
• Collaborate with cross-functional teams to evaluate business needs and objectives.
• Interpret trends and patterns in complex datasets to extract actionable insights.
• Conduct complex data analysis and effectively communicate findings to stakeholders.
• Prepare data for prescriptive and predictive modelling by cleaning, transforming, and aggregating data.
• Develop algorithms and prototypes to address specific business challenges.
• Identify opportunities for data acquisition from various sources.
• Develop analytical tools and programs to automate data processing and analysis.
• Design, implement, and maintain scalable data pipelines for streaming live data and its storage.
• Develop and optimize data models for efficient storage and retrieval of large datasets.

Requirements:

• Bachelor’s degree in data engineering, big data analytics, computer engineering, or related field.
• Proven experience as a data engineer, software developer, or similar role.
• Familiarity with big data technologies such as Hadoop, Spark, or suitable equivalents.
• Excellent analytical and problem-solving skills, with a keen attention to detail.
• Experience with IoT device provisioning, preferably vehicles, cameras, drones, and satellites.
• Experience with stream processing frameworks (e.g., Kafka, Spark Streaming) and workflow orchestration tools (e.g., Airflow, Luigi).
• Hands-on experience with cloud platforms (e.g., AWS) and related services (e.g., S3, EMR, BigQuery) is highly desirable.