Data Engineer | Enterprise & ERP Integrations
InnoWave is looking for a dynamic, agile person, good communication skills to complete our team. If you're based in Portugal, this might be the opportunity for you! We are looking for a Data Engineer to join our client's Data Office team and support the integration of ERP and other enterprise applications into the enterprise Data Lake.
Data Engineer | Enterprise & ERP Integrations
Responsibilities
Designing, developing and maintaining reliable data pipelines, transforming source-system data into standardized data models, and ensuring data quality and availability for downstream analytics, reporting and business applications.
Translate defined data requirements and mappings into robust technical implementations.
Design and implement data ingestion pipelines from ERP and other enterprise applications into the Data Lake.
Develop ETL/ELT pipelines using Databricks and related data engineering technologies. Extract data from SQL databases, APIs, files and other enterprise data sources. Implement data transformations, mappings and business rules defined with business and application teams.
Build and maintain structured Data Lake / Lakehouse data models.
Implement incremental loads, orchestration, scheduling and dependency management.
Develop data quality, validation and reconciliation controls across source and target systems.
Troubleshoot data integration and pipeline issues.
Monitor pipeline performance, reliability and data freshness.
Document data flows, mappings, transformations and technical dependencies.
Work closely with Business Analysts and Data Governance teams to ensure technical implementations meet business and governance requirements.
Skills
Degree in Computer Science or in similar areas.
Strong hands-on Data Engineering experience.
Strong SQL skills.
Experience developing ETL/ELT pipelines.
Experience with Databricks and/or Spark/PySpark.
Experience integrating data from relational databases and enterprise applications.
Experience with APIs, batch/file-based integrations and database ingestion.
Good understanding of Data Lake / Lakehouse architectures.
Experience with data transformation, mapping, validation and reconciliation.
Experience with pipeline orchestration and monitoring.
Ability to troubleshoot data quality and integration issues.
Experience working with Git and standard software/data engineering development practices.
Fluent in English - written and spoken (mandatory).
Nice to Have
Experience integrating ERP systems.
Experience with Oracle ERP or other enterprise ERP platforms.
Azure data services experience.
Delta Lake / Unity Catalog experience.
Python/PySpark development experience.
Experience with enterprise Data Governance and data quality frameworks.
InnoWave gives equal opportunity in employment regardless of gender, gender identity, sexual orientation, marital status, race, nationality, religion, age, disability, political beliefs, or any other factor. InnoWave will not pay fees to any third-party agency or company that does not have a signed agreement, do not submit resumes/CV's directly.
By answering to this job post, you consent the use of your data by InnoWave Group, for as long as necessary. We conduct regular data-cleansing and updating exercises to make sure the information we have is relevant and accurate. If you have any doubt or request to make relatively to your personal data, please send an e-mail.
- Department
- Data
- Role
- Data Engineering
- Locations
- InnoWave PT
- Remote status
- Hybrid