Overview
The role involves supporting the implementation of infrastructure projects and toolsets by building and scaling a web-based application with security integrated at all layers. The consultant will design, develop, and maintain frontend, backend, and data workflows, ensuring secure, compliant, and auditable handling of user datasets.
Key Responsibilities
- Build and maintain frontend and backend features with secure data interactions.
- Develop scalable FastAPI services for data ingestion, transformation, and delivery.
- Implement reliable, secure data workflows in Python and Databricks.
- Apply best practices (input validation, API authentication, secure session handling).
- Prevent common vulnerabilities.
- Design APIs and services with robust access control and abuse prevention.
- Implement secure storage patterns.
- Harden compute and data pipelines in Databricks.
- Implement authentication/authorization flows.
- Manage user and service-level roles across the application.
- Enhance CI/CD pipelines with automated testing, code quality checks, and security scans.
- Development and maintenance of secure, production-grade frontend and backend features.
- Implementation of documented APIs with integrated authentication and authorization.
- Development of data ingestion, processing, and output pipelines.
- Enhancement of automated tests and CI/CD checks covering both functionality and security.
- Integration of logging, monitoring, and alerting into deployed services.
- Submission of a well-structured documentation for code, workflows, and operational handoffs.
Required Experience
- At least five (5) years of demonstrated experience with a specific focus on designing and implementing automated data pipelines.
- Technical knowledge in: Python, SQL, Git, PostgreSQL, Microsoft Azure, Amazon Web Services, Docker, Kubernetes, Apache Airflow, etc.
- Frontend Development in JavaScript, TypeScript.
- Backend Development in Python (FastAPI).
- API design.
- Python pipelines, Databricks workflows, ETL security.
- Cloud (AWS).
- OAuth2, OIDC, JWT, role-based design.
- DevOps/CI/CD (GitHub, AzureDevops or similar).
Qualifications
Advanced university degree in computer science, data science, data engineering, telecommunications, or a related field OR education from a reputed college of advanced education with a diploma of equivalent standard to that of an advanced university degree in one of the fields above.
