JobsAisle
L

Senior Analyst - Data Engineering

LatentView Analytics Inc.

Chennai, India₹50,000–₹130,000/moAED 2.2K-5.7K/moToday
IndiaSQLPythonGCPGCSApache SparkHadoopKafkaBig QueryDataflowDataprocFull Time

Skills Required

PythonSqlMachine LearningCommunication

Job Description

Job Description As a Senior Analyst Data Engineering at our company, you will play a crucial role in designing, optimizing, and maintaining end-to-end data pipelines to support advanced analytics use cases in data-driven and cloud-based environments. You will have the opportunity to collaborate closely with data scientists, analysts, and client-facing teams. Key Responsibilities: Design, build, and maintain scalable, reliable, and high-performance end-to-end data pipelines (ETL/ELT). Develop and optimize complex SQL queries for data extraction, transformation, and reporting. Manage and transform large-scale structured and semi-structured datasets. Enable analytics and predictive modeling use cases by delivering clean, well-structured datasets. Utilize GCP services (Big Query, Dataflow, GCS, Dataproc, etc.) to enhance data processing and storage. Work with distributed and fault-tolerant data systems in cloud and traditional data warehouse environments. Document data pipelines, processes, and best practices to support knowledge sharing. Collaborate with cross-functional teams including data scientists, analysts, and engineers to understand data requirements. Work independently, owning deliverables end-to-end as an individual contributor. Continuously explore and adopt new tools, technologies, and best practices in data engineering. Required Skills & Expertise: 3+ years of experience in Data Engineering / Data Analytics roles. Strong hands-on expertise in SQL and Python. 3+ years of hands-on experience with GCP services such as Big Query, Dataflow, GCS, Dataproc. Proven experience building data pipelines from scratch in highly distributed, fault-tolerant systems. Experience working with relational and non-relational databases. Familiarity with Cloud SQL, Cloud Functions, Pub/Sub, Cloud Composer, and related services. Exposure to big data and open-source technologies such as Apache Spark, Hadoop, Kafka. Understanding of data requirements for machine learning and advanced analytics use cases. Strong documentation, communication, and collaboration skills. Inquisitive, proactive mindset with a passion for learning new tools and technologies. Comfortable working in dynamic environments with evolving and loosely defined problem statements. Why Join Us Opportunity to work on modern, cloud-native data platforms supporting advanced analytics and AI initiatives. Be part of a team building scalable data foundations for impactful business insights. Exposure to cutting-edge GCP, big data, and analytics technologies. A growth-oriented culture with continuous learning and hands-on ownership. As a Senior Analyst Data Engineering at our company, you will play a crucial role in designing, optimizing, and maintaining end-to-end data pipelines to support advanced analytics use cases in data-driven and cloud-based environments. You will have the opportunity to collaborate closely with data scientists, analysts, and client-facing teams. Key Responsibilities: Design, build, and maintain scalable, reliable, and high-performance end-to-end data pipelines (ETL/ELT). Develop and optimize complex SQL queries for data extraction, transformation, and reporting. Manage and transform large-scale structured and semi-structured datasets. Enable analytics and predictive modeling use cases by delivering clean, well-structured datasets. Utilize GCP services (Big Query, Dataflow, GCS, Dataproc, etc.) to enhance data processing and storage. Work with distributed and fault-tolerant data systems in cloud and traditional data warehouse environments. Document data pipelines, processes, and best practices to support knowledge sharing. Collaborate with cross-functional teams including data scientists, analysts, and engineers to understand data requirements. Work independently, owning deliverables end-to-end as an individual contributor. Continuously explore and adopt new tools, technologies, and best practices in data engineering. Required Skills & Expertise: 3+ years of experience in Data Engineering / Data Analytics roles. Strong hands-on expertise in SQL and Python. 3+ years of hands-on experience with GCP services such as Big Query, Dataflow, GCS, Dataproc. Proven experience building data pipelines from scratch in highly distributed, fault-tolerant systems. Experience working with relational and non-relational databases. Familiarity with Cloud SQL, Cloud Functions, Pub/Sub, Cloud Composer, and related services. Exposure to big data and open-source technologies such as Apache Spark, Hadoop, Kafka. Understanding of data requirements for machine learning and advanced analytics use cases. Strong documentation, communication, and collaboration skills. Inquisitive, proactive mindset with a passion for learning new tools and technologies. Comfortable working in dynamic environments with evolving and loosely defined problem statements. Why Join Us Opportunity to work on