About the Role
Design, build, and maintain robust, scalable, and efficient ETL/ELT data pipelines using tools such as Apache Spark, Databricks, or Airflow t o perform the following job duties.
Requirement: Minimum of Bachelor’s degree in Computer Science or Computer Engineering or Computer Information Systems or education + experience which is equivalent to a Bachelor’s degree in Computer Science or Computer Engineering or Computer Information Systems
Requirements
Design, build, and maintain robust, scalable, and efficient ETL/ELT data pipelines using tools such as Apache Spark, Databricks, or Airflow.
· Integrate data from diverse sources including APIs, RDBMS, cloud storage systems, and external services.
· Implement data quality checks, monitoring systems, and automated testing for pipeline stability.
· Support data modeling, schema design, and metadata management across analytical and operational systems.
· Manage and query structured and semi-structured data in platforms such as PostgreSQL, BigQuery, and MongoDB.
· Collaborate with senior engineers and architects to develop technical solutions that align with customer needs and business goals.
· Develop RESTful APIs and backend services using frameworks such as Flask, FastAPI, or Node.js.
· Participate in deployment and DevOps tasks on AWS, GCP, or Azure environments.
· Assist in optimizing system performance and debugging production issues in client-facing applications.
· Contribute to project documentation, test coverage, and code reviews.
· Work in an agile team environment, partnering with product managers, data scientists, and front-end engineers.
· Take ownership of assigned modules or features from design through implementation.
· Actively participate in sprint planning, daily standups, retrospectives, and technical discussions.
Maintain high standards of code quality, security, and reliability.
About the Company
Novateur Inc is an IT consulting company that puts its customers first. We offer a range of services designed to help businesses of all sizes get the most from their technology investments. Our team is made up of experienced and knowledgeable professionals who understand the importance of delivering high-quality solutions quickly and efficiently. Our mission is to help our customers succeed by providing tailored solutions that meet their unique needs. We strive to maintain the highest level of customer satisfaction and our commitment to excellence is evident in everything we do.