JobsAisle
L

Senior Analyst - Data Engineering

LatentView Analytics Limited

Chennai, India₹50,000–₹130,000/moAED 2.2K-5.7K/moToday
IndiaSQLPythonGCPGCSApache SparkHadoopKafkaBig QueryDataflowDataprocFull Time

Skills Required

PythonSqlMachine LearningCommunication

Job Description

Job Description As a Senior Analyst Data Engineering, your role will involve designing, optimizing, and maintaining end-to-end data pipelines to support advanced analytics use cases within data-driven and cloud-based environments. You will collaborate closely with data scientists, analysts, and client-facing teams. Your responsibilities will include: - Designing, building, and maintaining scalable, reliable, and high-performance end-to-end data pipelines (ETL/ELT). - Developing and optimizing complex SQL queries for data extraction, transformation, and reporting. - Managing and transforming large-scale structured and semi-structured datasets. - Enabling analytics and predictive modeling use cases by delivering clean, well-structured datasets. - Utilizing GCP services (Big Query, Dataflow, GCS, Dataproc, etc.) to enhance data processing and storage. - Working with distributed and fault-tolerant data systems in cloud and traditional data warehouse environments. - Documenting data pipelines, processes, and best practices to support knowledge sharing. - Collaborating with cross-functional teams to understand data requirements. - Working independently, owning deliverables end-to-end as an individual contributor. - Continuously exploring and adopting new tools, technologies, and best practices in data engineering. Required Skills & Expertise: - 3+ years of experience in Data Engineering / Data Analytics roles. - Strong hands-on expertise in SQL and Python. - 3+ years of hands-on experience with GCP services such as Big Query, Dataflow, GCS, Dataproc. - Proven experience building data pipelines from scratch in highly distributed, fault-tolerant systems. - Experience working with relational and non-relational databases. - Familiarity with Cloud SQL, Cloud Functions, Pub/Sub, Cloud Composer, and related services. - Exposure to big data and open-source technologies such as Apache Spark, Hadoop, Kafka. - Understanding of data requirements for machine learning and advanced analytics use cases. - Strong documentation, communication, and collaboration skills. - Inquisitive, proactive mindset with a passion for learning new tools and technologies. - Comfortable working in dynamic environments with evolving and loosely defined problem statements. This role offers you the opportunity to work on modern, cloud-native data platforms supporting advanced analytics and AI initiatives. You will be part of a team building scalable data foundations for impactful business insights and gain exposure to cutting-edge GCP, big data, and analytics technologies. The company is an equal opportunity employer that values diversity and inclusion. As a Senior Analyst Data Engineering, your role will involve designing, optimizing, and maintaining end-to-end data pipelines to support advanced analytics use cases within data-driven and cloud-based environments. You will collaborate closely with data scientists, analysts, and client-facing teams. Your responsibilities will include: - Designing, building, and maintaining scalable, reliable, and high-performance end-to-end data pipelines (ETL/ELT). - Developing and optimizing complex SQL queries for data extraction, transformation, and reporting. - Managing and transforming large-scale structured and semi-structured datasets. - Enabling analytics and predictive modeling use cases by delivering clean, well-structured datasets. - Utilizing GCP services (Big Query, Dataflow, GCS, Dataproc, etc.) to enhance data processing and storage. - Working with distributed and fault-tolerant data systems in cloud and traditional data warehouse environments. - Documenting data pipelines, processes, and best practices to support knowledge sharing. - Collaborating with cross-functional teams to understand data requirements. - Working independently, owning deliverables end-to-end as an individual contributor. - Continuously exploring and adopting new tools, technologies, and best practices in data engineering. Required Skills & Expertise: - 3+ years of experience in Data Engineering / Data Analytics roles. - Strong hands-on expertise in SQL and Python. - 3+ years of hands-on experience with GCP services such as Big Query, Dataflow, GCS, Dataproc. - Proven experience building data pipelines from scratch in highly distributed, fault-tolerant systems. - Experience working with relational and non-relational databases. - Familiarity with Cloud SQL, Cloud Functions, Pub/Sub, Cloud Composer, and related services. - Exposure to big data and open-source technologies such as Apache Spark, Hadoop, Kafka. - Understanding of data requirements for machine learning and advanced analytics use cases. - Strong documentation, communication, and collaboration skills. - Inquisitive, proactive mindset with a passion for learning new tools and technologies. - Comfortable working in dynamic environments with evolving and loosely defined problem statements. This role offers you the opportunity to work on modern, cloud-native data platf