Data Engineer

Job description

Azure Data EngineerAbout the RoleWe are seeking a highly skilled Azure Data Engineer to join our growing data and analytics team. In this role, you will design, develop, and maintain scalable, automated data pipelines and data products that support enterprise data architecture and analytics initiatives. You will work closely with data scientists, analysts, architects, and business stakeholders to deliver high-quality, reliable, and cost-effective data solutions leveraging the Microsoft Azure ecosystem.The ideal candidate is passionate about building modern data platforms, optimizing ETL processes, and applying software engineering principles to create resilient and scalable data solutions.Key ResponsibilitiesDesign, develop, and maintain automated data pipelines and ETL processes using Microsoft Azure technologies including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Microsoft Fabric.Utilize Azure Data Lake Storage Gen2 and Azure Blob Storage to organize and maintain data assets.Collaborate with data scientists, data analysts, architects, and business stakeholders to understand requirements and deliver scalable data solutions.Optimize data pipelines for performance, reliability, scalability, and cost efficiency.Implement data quality and validation frameworks to ensure data integrity.Monitor, troubleshoot, and resolve data pipeline and processing issues.Develop and maintain technical documentation, configurations, and best practices.Manage CI/CD processes for deploying and maintaining data solutions.Apply software engineering principles such as testing, version control, and modular development.Stay current with emerging technologies and recommend improvements to existing data platforms. Required QualificationsBachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent experience).Proven experience as a Data Engineer or in a similar role working with ETL and data pipelines.Strong experience with Microsoft Azure services, including:Azure Data Factory (ADF)Azure Synapse AnalyticsAzure DatabricksMicrosoft FabricAzure Data Lake Storage Gen2Azure Blob StorageStrong SQL skills and experience working with relational databases such as SQL Server and PostgreSQL.Experience with big data technologies, particularly Apache Spark.Solid understanding of software engineering principles including CI/CD, version control, and testing.Strong analytical, troubleshooting, and problem-solving skills.Excellent communication and collaboration abilities. Preferred QualificationsStrong experience with Python and PySpark.Experience with other programming languages such as Scala, Java, or C#.Experience building Spark applications and processing large datasets.Familiarity with file formats such as Parquet, Delta, and Avro.Experience consuming and integrating data from REST APIs and other external data sources.Knowledge of Azure subscriptions, resource groups, and cloud architecture concepts.Experience using Git workflows and Azure DevOps repositories and pipelines.Familiarity with infrastructure automation tools such as Ansible.Ability to provide technical leadership and consult with stakeholders on business requirements and data solutions.Strong learning agility and a continuous improvement mindset. Why Join Strategic Staffing Solutions (S3)?✅ Full-Time Permanent Employment✅ Competitive Salary Package✅ Hybrid Work Setup: Ayala Makati (2 Days Onsite / 3 Days Remote)✅ HMO Coverage: Up to 500K✅ Leave Credits: Prorated, applicable on first day✅ FIXED WEEKEND OFF✅ PAID HOLIDAYS✅ Government Benefits✅ 13th Month Pay✅ Team Building Activities