data engineer specialist

Jobs for Humanity is partnering with testmar_27_v2 to build an inclusive and just employment ecosystem. Therefore, we prioritize individuals coming from all walks of life.Company Name: testmar_27_v2We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data infrastructure that supports our organization's data-driven decision-making processes. You will work with cutting-edge technologies to ensure efficient data flow and accessibility for analytical and machine learning applications.Job PurposeThe primary purpose of this role is to develop and maintain scalable, reliable data infrastructure that enables efficient data collection, storage, processing, and accessibility for analysis and machine learning applications, supporting data-driven decision making across the organization.Job Duties And ResponsibilitiesData Infrastructure DesignData Collection & StoragePython ProgrammingSQL DevelopmentScala ProgrammingApache Spark ImplementationKafka IntegrationAirflow Workflow ManagementAWS Cloud PlatformGCP Cloud PlatformData Pipeline DevelopmentETL/ELT ProcessesData WarehousingData Processing OptimizationSystem Reliability MaintenanceRequired QualificationsPython ProficiencySQL ExpertiseScala KnowledgeApache Spark ExperienceKafka ExperienceAirflow ExperienceAWS Cloud PlatformGCP Cloud PlatformData Infrastructure DesignData Pipeline DevelopmentDatabase Systems UnderstandingData Warehousing KnowledgeETL/ELT Process ExperienceCloud Platform ExperienceProgramming Language Proficiency#J-18808-Ljbffr