Descriptif du poste
Job Description
With data at the core of Soongo both as a product and market differentiator, you will have a pivotal role within the company, working directly on the product. We are seeking a skilled and driven Data Engineer to join our team at Soongo pivotal phase of transition from MVP to full commercial scaling. Directly working with the co-founders, your mission will be to automate and improve the robustness of our data pipelines to help us onboard more clients, more quickly and with perfect data accuracy from the get go. As the company grows, this role has a clear potential to turn into a lead or engineering manager role. In this capacity, your responsibilities will center around:
Main Responsibilities:
1. Data Pipeline Development:
Design, develop, and maintain robust data pipelines on AWS to ensure seamless data flow from various sources.
Implement data collection processes via API, SFTP, and SES.
2. Data Transformation:
Utilize Pandas-based transformation processes to clean, transform, and prepare data for analysis.
Ensure data quality and integrity throughout the transformation process.
3. Database Integration:
Integrate transformed data into a PostgreSQL Aurora Database.
Develop and optimize procedural PostgreSQL queries to support data analysis and reporting.
4. Collaboration and Communication:
Work closely with the data science and product teams to understand data requirements and deliver actionable insights.
Communicate effectively with stakeholders to ensure data-driven decision-making.
5. Monitoring and Maintenance:
Monitor data pipelines for performance and reliability.
Troubleshoot and resolve any issues that arise in the data pipeline or database.