Backend Engineer (Data Platform)

Headquarters: London
URL: https://www.desia.ai/

• Developing and enhancing data pipelines: Create and expand existing data processing pipelines for both structured and unstructured datasets (mainly Python and SQL)
• Integrating with third-party systems: Work with external tools and APIs (e.g., Microsoft GraphAPI, financial data providers) to enable seamless data flow between third-party systems and Desia.
• Monitoring and optimizing performance: Track the performance of the data platform, analyze logs, and recommend infrastructure improvements using tools like GCP, Sentry, and CloudSQL.
• Collaborating on data modeling: Design and implement efficient data structures for relational and non-relational systems to support scalable and reliable data processing.
• Ensuring system reliability: Contribute to the stability and scalability of the platform by addressing bottlenecks, optimizing queries, and ensuring smooth operation of containerized environments (e.g., Docker, Kubernetes).

• Strong Python expertise: proven working experience in both scripting and object-oriented programming (OOP).
• Solid SQL skills: Experience with writing efficient queries and optimizing database performance.
• Data modeling: Hands-on experience designing and organizing data in both relational and non-relational formats.
• Communication skills: Excellent verbal and written communication in English.
• Adaptability: A quick learner who can bridge knowledge gaps to tackle new challenges effectively.
• Collaborative mindset: Open to sharing ideas, providing feedback, and contributing to discussions constructively.

• Cloud experience: Familiarity with Google Cloud Platform (GCP).
• Containerization knowledge: Working familiarity with tools like Docker and Kubernetes.
• Database expertise: Experience with PostgreSQL.
• Scheduling: Working experience with task scheduling (ex. cron, dag's like Airflow)
• Python libraries: Knowledge of libraries such as asyncio, pydantic, fastapi, and psycopg
• Search technologies: Familiarity with ElasticSearch or OpenSearch.
• System design: Experience with RESTful APIs and queue-based systems.

• Holding a Master's degree in Computer Science or a related field or possessing similar practical experience.
• A minimum of 3 years professional experience in Data Platform Engineering or Backend roles

• Salary depending on experience and skills (£40000 - £65000)
• Performance bonuses
• Stock options and retirement plan

To apply: https://weworkremotely.com/remote-jobs/desia-limited-backend-engineer-data-platform