Get new jobs by email
- ...ensure that accurate and consistent data is available precisely when and where it's needed. Responsibilities: Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations. Design and run tests for data validation, storage, and retrieval...
- ...Ensure data quality and consistency using tools like Great Expectations Write modular, well-tested, and maintainable Python and SQL code Develop an observability layer to monitor and optimize performance across data pipelines Lead and mentor a team of data engineers...
- ...AWS EMR ~ Strong experience in developing data pipelines using PySpark and ETL tools like ADF, Talend ~ Proficiency in Python & SQL ~ Strong problems solving and critical thinking skills ~ Experience of writing effective and maintainable unit and integration tests...
- ...~ Built and scaled WebSockets features in production. ~ Proficiency with Redis/Valkey for caching and real-time patterns; strong SQL fundamentals (PostgreSQL/MySQL) and practical ORM experience (TypeORM/Prisma). ~ Testing mindset with meaningful coverage and CI checks...
- ...clear Root Cause Analysis (RCA) reports for all major incidents P1/P2 , including impacted customer identification via logs. Use SQL effectively for data validation, impact analysis, and troubleshooting. Maintain a proactive approach , continuously improving...
- ...cloud technologies. ~ Data lake architecture, including data model design and implementation (incl. relational, dimensional, and No-SQL). ~ Enterprise Application and Data Integration design and implementation (e.g. ETL, messaging, replication, and APIs). ~ Telco...
- ...Expertise in incident management, debugging, and root cause analysis. ~ Hands-on experience with messaging systems (Kafka) and databases (SQL/NoSQL). ~ Proficiency in cloud platforms (AWS, Kubernetes); GCP is a plus. ~ Familiarity with CI/CD pipelines (GitLab, Terraform)...
- ...solutions. Expertise with data quality libraries such as Great Expectations, Deequ, Soda Core, or equivalent. Solid understanding of SQL and ability to validate transformations over large-scale datasets. Familiarity with Apache Spark (PySpark) and real-time data...
- ...workloads. Enforce data quality standards through DBT tests and pipeline observability tooling. Write clean, well-tested Python and SQL code and actively participate in code reviews. Lead and mentor a team of data engineers ; contribute to sprint planning,...
- ...developing modular DBT transformations, and designing Snowflake schemas. Ideal candidates should have strong programming skills in Python and SQL, along with experience in Databricks and cloud platforms. Join a vibrant culture focused on innovation and collaboration. #J-18808-...
Confiz Limited
Multan2 days ago
