Data Engineer
| Company |
Contract |
RAL |
| Intella |
Full remote |
40k - 55k |
As Data Engineer, you’ll be a key member of the team, responsible for building, maintaining, and optimizing our data pipelines and infrastructure. You’ll work with cutting-edge tools and technologies like Python Prefect, DuckDB, Polars, and cloud platforms to ensure the seamless flow of data across systems. Your contributions will be pivotal in ensuring the scalability and efficiency of our data processing capabilities to support a growing volume of data and users.
Key Responsibilities
- Design, build, and maintain scalable data pipelines to support our growing data needs.
- Optimize and automate data workflows, ensuring data are always available for analysis and business decision-making inside our platform.
- Collaborate with cross-functional teams to ensure data quality and integrity.
- Support the development of internal Python libraries and backend systems.
- Implement best practices for data security and governance.
- Ensure data infrastructure can scale effectively to handle increasing volumes and complexity.
- Work with the team to integrate new customer data inside the tool.
- Propose and integrate new technologies to enhance data processing capabilities.
Requirements
- Proven experience as a Data Engineer, with expertise in ETL processes, data pipeline architecture, and data management.
- Experience with cloud platforms like AWS, GCP, or Azure.
- Strong SQL and Python skills for data manipulation and automation.
- Experience with distributed systems and handling large datasets in a production environment.
- Familiarity with best practices in data security, governance, and data privacy regulations.
- Passion for working with data and a commitment to continuous learning and improvement.
- Excellent problem-solving skills and the ability to work effectively in a remote team.