Senior Python Data Engineer

Job Description In this role, you will be part of the Surveillance Enhancement Program (SEP), a multi-year program focusing on building and enhancing the surveillance platform to detect potential instances of market misconduct, market manipulation, and market abuse. Your responsibilities will include: - Developing software applications based on business requirements - Maintaining software applications and making enhancements according to project specifications - Participating in requirement analysis, design, development, testing, and implementation activities - Proposing new techniques and technologies for software development - Performing unit testing and user acceptance testing to evaluate application functionality - Ensuring completion of assigned development tasks within deadlines - Working in compliance with coding standards and best practices - Providing assistance to junior developers when needed - Performing code reviews and recommending improvements - Reviewing business requirements and recommending changes to develop reliable applications - Developing coding documentation and other technical specifications for assigned projects - Acting as the primary contact for development queries and concerns - Analyzing and resolving development issues accurately Skills Required: - 5-10 years of experience in data-intensive python development - Proven experience as a core Python developer - Experience developing Classes, OOPS, exception handling, parallel processing - Strong knowledge of DB connectivity, data loading, transformation, calculation - Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations - Lambda Functions, Decorators - Vector operations on Pandas dataframes/series - Application of applymap, apply, map functions - Concurrency and error handling data pipeline batch of size [1-10 gb] - Ability to understand business requirements and translate them into technical requirements - Ability to design architecture of data pipeline for concurrent data processing - Familiarity with creating/designing RESTful services and APIs - Familiarity with application unit tests - Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services - Debugging application Nice to have: - Knowledge of web backend technology - Django, Python, PostgreSQL - Apache Airflow - Atlassian Jira - Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus - Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus Please note that the job description did not provide any additional details about the company. In this role, you will be part of the Surveillance Enhancement Program (SEP), a multi-year program focusing on building and enhancing the surveillance platform to detect potential instances of market misconduct, market manipulation, and market abuse. Your responsibilities will include: - Developing software applications based on business requirements - Maintaining software applications and making enhancements according to project specifications - Participating in requirement analysis, design, development, testing, and implementation activities - Proposing new techniques and technologies for software development - Performing unit testing and user acceptance testing to evaluate application functionality - Ensuring completion of assigned development tasks within deadlines - Working in compliance with coding standards and best practices - Providing assistance to junior developers when needed - Performing code reviews and recommending improvements - Reviewing business requirements and recommending changes to develop reliable applications - Developing coding documentation and other technical specifications for assigned projects - Acting as the primary contact for development queries and concerns - Analyzing and resolving development issues accurately Skills Required: - 5-10 years of experience in data-intensive python development - Proven experience as a core Python developer - Experience developing Classes, OOPS, exception handling, parallel processing - Strong knowledge of DB connectivity, data loading, transformation, calculation - Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations - Lambda Functions, Decorators - Vector operations on Pandas dataframes/series - Application of applymap, apply, map functions - Concurrency and error handling data pipeline batch of size [1-10 gb] - Ability to understand business requirements and translate them into technical requirements - Ability to design architecture of data pipeline for concurrent data processing - Familiarity with creating/designing RESTful services and APIs - Familiarity with application unit tests - Working with Git source