Data Engineer

Data Engineer - EY GDS Spain - Hybrid The opportunity We are seeking a highly skilled and experienced Senior Data Engineer with a minimum of 3+ years of experience in designing building and maintaining scalable data pipelines and data platforms. The ideal candidate should have strong hands-on experience with Python SQL and PySpark working with large-scale data processing systems and be comfortable collaborating in German-speaking environments supporting international stakeholders and projects. As a member of our team in the EY GDS Spain office in Malaga youll have a chance to extend your knowledge experience by working on interesting projects with the newest technologies and approaches. Youll support clients in choosing the most suitable business solution and take part in digital transformation. Your key responsibilities - Design and develop scalable data pipelines for batch and streaming processing. - Implement and maintain efficient ETL/ELT workflows for data ingestion and transformation. - Process and analyze large-scale datasets using distributed technologies such as PySpark. - Optimize data performance quality and reliability across systems and pipelines. - Collaborate with cross-functional teams to deliver robust data-driven solutions. - Apply best software engineering practices to ensure clean maintainable and production-ready code. Skills and attributes for success For example - Strong hands-on experience with Python for data processing pipeline development and automation. - Advanced proficiency in SQL for data extraction transformation and performance optimization. - Practical experience using PySpark for distributed data processing and handling large datasets. - Experience designing and implementing ETL/ELT pipelines for batch and/or streaming data. - Understanding of data modeling concepts and data warehouse/lake architectures. - Experience working with distributed systems and large-scale data environments (e.g. Spark-based platforms). - Familiarity with data formats such as Parquet ORC JSON and Avro. - Strong software engineering practices including Git code versioning testing and modular design. - Experience writing maintainable scalable and performant data pipelines. To qualify for the role you must have - At least 2 years of experience in Data Engineering or related fields building and maintaining data pipelines in production environments. - Bachelors or Masters degree in Computer Science Engineering Data Engineering or a related technical field. - Strong communication skills with the ability to work effectively in cross-functional and international teams. - Good command of MS Office Suite (Excel Power Point Word Outlook etc.) - Fluency in German (mandatory) for communication with stakeholders and documentation. Ideally youll also have - Cloud Data Platforms Experience working with cloud platforms (Azure AWS or GCP) for data storage and processing. - Orchestration Automation Experience with workflow orchestration tools such as Airflow Azure Data Factory or similar. - Performance Optimization Experience optimizing Spark jobs SQL queries and data pipelines for efficiency and cost. - Data Governance Quality Understanding of data quality frameworks data lineage and governance best practices. What we look for We are looking for a proactive and collaborative professional who thrives in an international environment contributing effectively as part of a global team. The selected candidate will take ownership of responsibilities actively support team members and ensure clear and continuous communication keeping stakeholders and senior colleagues informed of progress and key updates. The ideal candidate demonstrates a strong sense of accountability a positive mindset and the ability to deliver high-quality results within tight deadlines and fast-paced demanding environments. What we offer In EY GDS Spain were committed to fostering a vibrant environment where every team member can thrive. We provide a space for continuous learning and the flexibility to define your own success empowering you to make a meaningful impact in your own way. Our diverse and inclusive culture values who you are and encourages you to help others find their voice. Additionally heres what makes us stand out - Empowering Career Development Unlock your potential with tailored training and development programs designed to elevate your skills and propel your career forward. We invest in your growth because your success is our success. - Flexible Work-Life Integration Enjoy the freedom of our hybrid work model allowing you to blend professional responsibilities with personal passions. We understand that life is more than just work and we support you in achieving that balance. - Comprehensive Well-Being Programs Prioritize your health with our extensive wellness initiatives including psychological support sessions and health resources. At EY GDS Spain your well-being is at the heart of what we do. - Meaningful Volunteering Opportunities Make a difference in your community through our engaging volunteering programs. Join us in giving back and creating a positive impact while building connections with like-minded colleagues. - Recognized Performance and Rewards Celebrate your achievements with our recognition programs that honor both individual and team successes. We believe in acknowledging hard work and dedication ensuring you feel valued every step of the way.